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_G ■ Abstract 

C^ . In this paper we study the Poisson Hypothesis, which is a device to 

analyze approximately the behavior of large queueing networks. We 
prove it in some simple limiting cases. We show in particular that the 
. corresponding dynamical system, defined by the non-linear Markov 

rS I process, has a line of fixed points which are global attractors. To do 

C^ ' this we derive the corresponding non-linear equation and we explore 

its self- aver aging properties. We also argue that in cases of havy-tail 
service times the PH can be violated. 

MSC-class: 82C20 (Primary), 60J25 (Secondary) 

1 Introduction 

The Poisson Hypothesis deals with large queueing systems. For general sys- 
tems one can not compute exactly the quantities of interest, so various ap- 
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proximations are used in practice. The Poisson Hypothesis was formulated 
first by L. Kleinrock in ^. It is the statement that certain approximation 
becomes exact in the appropriate hmit. It concerns the following situation. 
Suppose we have a large network of servers, through which many customers 
are travelling, being served at different nodes of the network. If the node 
is busy, the customers wait in the queue. Customers are entering into the 
systems via some nods, and the external flows of customers from the outside 
are Poissonian. The service time at each node is random, with some flxed 
distribution, depending on the node. We are interested in the stationary 
distribution -kj^i at a given node M: what is the distribution of the queue 
at it, what is the average waiting time, etc. Except for a very few special 
cases, when the service times are exponential, the distributions t^j^ in general 
can not be computed. The recipe of the Poisson Hypothesis for approximate 
computation of 'Kj^ is the following: 

• consider the total flow T of customers to the node M . (In general, T 
is not Poissonian, of course.) Replace T with a constant rate Poisson 
flow P, the rate being equal to the average rate of T . Compute the 
stationary distribution t[j,j at A/", corresponding to the inflow V . (These 
computations are the subject of classical queueing theory and usually 
provide explicit formulas.) The claim is that vr^ ~ vr^. 

The Poisson Hypothesis is supposed to give a good estimate if the internal 
flow to every node A/" is a sum of flows from many other nodes, and each of 
these flows constitute only a small fraction of the total flow to M . 

Clearly, the Poisson Hypothesis can not be literally true. It can hopefully 
hold only after some kind of "thermodynamic" limit is taken. Its meaning 
is that in the long run the different nodes become virtually independent, i.e. 
propagation of chaos takes place. The reason for that should be that any 
synchronization of the nodes, if initially present, dissolves with time, due to 
the randomness of the service times. 

In the present paper we prove the Poisson Hypothesis for the information 
networks in some simple cases. Namely, we will consider the following closed 
queueing network. Let there be M servers and iV customers to be served. 
The distribution of the service time is given by some flxed random variable r]. 
Upon being served, the customer chooses one of M servers with probability 
-^, and goes for the service there. If there is a queue, he waits for his turn. 
Then in the limit M, iV — > cxd, with ^ ^ P, the Poisson Hypothesis holds. 



under certain general restrictions on rj. More precisely, Poisson Hypothesis 

for our model states that: 

1. every fc-tuple of servers becomes asymptotically mutually independent 
and identically distributed, as M, N -^ oo, for any k, 

2. the total flow J^m,n of customers to a given node goes, as M, N ^ oo, 
to a Poisson flow V, 

3. the rate function A (t) of the Poisson flow V goes to a constant limit 
c{p), as t — *• cxo, which depends only on the load p and thus can be 
(easily) computed apriori. 

To be precise, one needs also to put conditions on convergence of the se- 
quence of initial states i'm,n of our servers, in order the above to hold, see 
Section 131 for more details. 

In this paper we prove the Poisson Hypothesis (PH) in the following cases: 

• for a special class of the service times t] (with some exponential mo- 
ments finite; actually a bit more is needed, see (fT^ ) - with no extra 
conditions; 

• for general rj-s with heavy tails - provided the initial state of our system 
possesses certain desynchronization property (valid once the expected 
service time is finite, see flTS|) ). 



In a subsequent paper |RSj we will show that for rj-s with only polynomial 
moments and for certain initial states the initial synchronization of the nodes 
may not vanish with time. So PH can be violated, we can not predict the 
long time behavior of a single server, and we have the phenomenon of phase 
transition, which manifests itself in the strong dependence on the initial state 
of the system. 

An important step in establishing the validity of PH was made in the pa- 
per jKRlj . Namely, the properties 1 and 2 were obtained there. However, the 
technique of |KRlj was not enough to prove the relaxation property A (t) — *• c, 
and moreover it does not hold in general. It was proven there that the situ- 
ation at a given single server is described by the so-called non-linear Markov 
process pt with Poissonian input with rate A (t) , and the (non-Poissonian) 
output with the same rate A (t). The remaining problem can be formulated 



as follows: this non-linear Markov process defines some complicated dynam- 
ical system, and the question is about its invariant measures. Namely, this 
system has one parameter family of fixed points, and one needs to show that 
every trajectory converges to one of them. 

In the present paper we complete the program, showing that the above 
relaxation A (t) — > c indeed takes place for certain class of the service times r) 
and certain class of initial states, and so fit — > fic, where fic is the stationary 
distribution of the stationary Markov process with the Poisson input, corre- 
sponding to constant rate A (t) = c. In the language of dynamical systems, 
we find conditions under which there are no other invariant measures except 
these defined by the fixed points. 

The central discovery of the present paper, which seems to be the key to 
the solution of the problem, is that, roughly speaking, the function A (t) has 
to satisfy the following non-linear equation: 

A(t) = [A(-)*gA,(-)]W- (1) 

Here * stays for convolution: for two functions a (■) , 6 (•) it is defined as 

[a (■) * b (■)] (t) = a(t-x)b (x) dx, 



while qx^t (■) is a family of probability densities with t real, which depends 
also in an implicit way on the unknown function A (■). We call (P) the self- 
averaging property. The present paper consists therefore of two parts: we 
prove that indeed the self-averaging relation holds, and we prove then that 
in certain cases it implies relaxation. The self-averaging property is a special 
case of a more general averaging relation (j29p , which relates the output 
flow rate to the input flow rate in a queuing process with one server (called 
M{t)/GI/l in queueing theory jargon). It appears to be new. 

It is amazing that the relation (^ depends crucially on the validity of some 
purely combinatorial statement concerning certain problem of the placement 
of the rods on the line M^, see Section 6. This validity seems not at all obvious 
or to be expected, so to have it is our luck. 

To fix the terminology, we remind the reader here what we mean by the 
non-linear Markov process (see jMlj . |M2j ) . We do this for the simplest 
case of discrete time Markov chains, taking values in a finite set S, \S\ = k. 
In such a case the set of states of this Markov chain is a simplex A^ of all 
probability measures on S, A^ = {fi = (pi, ...,Pk) '■ Pi > 0,pi + ... + pk = 1} , 



while the Markov evolution defines a map P : Aj. -^ A^. In the case of usual 
Markov chain P is affine, and this is why we will call it linear chain. In this 
case the matrix of transition probabilities coincides with P. The non-linear 
Markov chain is defined by a family of transition probability matrices P^, 
/i G Afc, so that matrix element P^ (hj) is a probability of going from i to j 
in one step, starting in the state fi. The (non-linear) map P is then defined 

by P (/i) = /iP/.- 

The ergodic properties of the linear Markov chains are settled by the 
Perron- Frobenius theorem. In particular, if the linear map P is such that the 
image P (A^) belongs to the interior Int (A^) of A^, then there is precisely 
one point /i G Int (A^) , such that P {^) = /i, and for every u G A^ we have 
the convergence P" (z/) — > yU as n ^ oo. 

In case P is non-linear, we are dealing with more or less arbitrary dy- 
namical system on A^, and the question about stationary states of the chain 
or about measures on A^ invariant under P can not be settled in general. 

Therefore it is natural to ask about the specific features of our dynamical 
system, which permit us to find all its invariant measures. We explain this 
in the following subsection. The reader who is not interested in this aspect 
of the problem can safely skip it. 

Dynamical systems aspect. Here we will use the notation of the paper, 
though in fact the situation of the paper is more complicated; in particular the 
underlying space is not a manifold, but a space of all probability measures over 
some non-compact set. 

Let Af be a manifold, supplied with the following structures: 

• for every point fj, E M and every A > a tangent vector X (/i. A) at fi is 
defined, 

• a function b : M ^^ R^ is fixed. 

We want to study the dynamical system 

|/z(t)=X(^(t),6(^(t))). (2) 

Its flow conserves another given function, N : M ^ R^ ^ and we want to prove 
that our dynamical system has one-parameter family of fixed points - each corre- 
sponding to one value of A^ - and no other invariant measures. 

We have the following extra properties of our dynamical system: 



Let A (t) > 0; consider the differential equation 

^/i(t)=X(^(t),A(t)), t>0, (3) 

with yU (0) = V. We denote the solution to it by ^iv^x{.) (t) . We know that 

for every c > and every initial data u, the solution ^u,\{) (^) to Q converges 
to some stationary point u^. G M, 

l^u,\{) if) ~^ ^ci provided A (t) — > cas t — > oo, (4) 

• for the function N we have 
d 



dt 



N (/i.,A(.) (t)) =X{t)-b (/i,,A(.) (t)) 



In particular, for every trajectory fli, (t) of (j21) (where /ij, (0) = u) we have 
A/" (/i,^ (t)) = A/" (i^) . Also, N (fc) is continuous and increasing in c; 

for every u, A (■) and every t > there exists a probability density q,^^x^t (x) , x > 
0, such that 

b i^uM-) (t)) = (A * g^,A,i) (t) , 



where 



(A * qu,x,t) (y) = / qu,x,t (x) \{y -x) dx. 

Jx>0 



The family q^ x t (x) satisfies: 



and 



/ Qiy,x,t (x) dx = 1 for all v, A, t, 
Jo 



inf g^,A,t (a;) > 



xG[0,l] 

(absolute continuity with respect to Lebesgue). 
Then for every initial state v 

fj'u (t) -> J^c, (5) 

where c satisfies A^ (uc) = N (u) . 
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Our statement follows from the fact that the self-averaging property, 

/ it) = (/ * qt) (t) , 

with qt (■) being a family of probability densities on [0, 1], implies that / (t) — >■ 
const as t — s> oo, so (0) follows from Q . This implication is the subject of the 
Theorems EH El iSl 

We feel that the relation ([Q) is an important feature of the subject we 
are interested in. Therefore in the present paper we study it and the related 
questions in some generality. 

i) We start with the equation 

/ (t) = [f (•) * qt (■)] (t) . (6) 

Here we suppose that qt (■) is just some one-parameter family of probability 
densities (independent of / ), so ((T)) is a special case of (jHI) • On the other 
hand, we suppose additionally that all the distributions gt (■) are supported 
by some finite interval. We establish relaxation in this case. 

ii) We then do the same for the case of distributions gt (■) with unbounded 
support. 

iii) Last, we treat the true problem, where in addition to the infinite 
support, an extra parameter fj, appears and an extra perturbation is added 
to convolution term in © : 

A (t) = (1 - e,,, (t)) [A (•) * q,,,,t (■)] (t) + ex,, (t) Q,,, (t) . (7) 

Here the parameter e\^^ (t) is small: ex^^ (t) ^ as t ^ oo, the term Qa,^ (t) 
is uniformly bounded, while the meaning of /i will be explained later. 

As we proceed from i) to iii), we will have to assume more about the 
class of distributions {q.} , for which the self-averaging implies relaxation. 

We finish this introduction by a brief discussion of the previous work on 
the subject, and their methods. 

As we said before, part of the proof of the Poissonian Hypothesis - the 
so called Weak Poissonian Hypothesis - was obtained in |KRlj . By prov- 
ing that the Markov semigroups describing the Markov processes for finite 
M , N, after factorization by the symmetry group of the model converge, as 
M, N -^ oo, ^ ^ p, to the semigroup, describing the non-linear Markov 
process, the authors have proven that the limit flows to each node are inde- 
pendent Poisson flows with the same rate function A (t) . This statement is 



fairly general, and can be generalized to other models with the same kind of 
the symmetry - the so-called mean-field models. The general theory - see, 
for example, [Li] - implies then, that all the limit points of the stationary 
measures of the Markov processes with finite M, N are invariant measures 
of the limiting non-linear Markov process. The remaining step - the proof 
that the limiting dynamical system has no other attractors except the one- 
parameter family of the fixed points - is done in the present paper for some 
class of the service times rj. Apriori this fact is not at all clear, and one can 
construct natural examples of the systems with many complicated attractors, 
which are reflected in the complex behavior of the Markov processes with fi- 
nite M, A^. However, the self- averaging property, explained above, rules out 
such a possibility. It seems that the self-averaging property can also be gen- 
eralized to other mean-field models. In a forthcoming paper |RSj we show 
that for more general service times the corresponding dynamical system has 
more complicated attractors, so that the relaxation \{t) ^ c might or might 
not hold, depending on the initial state. 

The Poisson Hypothesis was fully established in a pioneer paper [St] for 
a special case when the service time is non-random. This is a much simpler 
case, and the methods of the paper can not be extended to our situation. 
They are sufficient for a simpler case of the Poissonian service times, which 
case was studied in |KR2j . 

The paper |DKVj deals with another mean-field model, describing some 
open queueing network. Though the Poisson Hypothesis does not hold for 
it, the spirit of the main statement there is the same as in the present pa- 
per: the limiting dynamical system has precisely one global attractor, which 
corresponds to the fixed point. 

One of specific feature of the method of the paper |DKVj . as well as re- 
lated paper pFj . is that the Markov processes have countable sets of values. 
They also correspond to open networks, when the customers are coming into 
the system from the outside and leave it after being served. So one can in 
principle use monotonicity arguments and stochastic domination. In our sit- 
uation the phase space is (one-dimensional) real manifold, while the number 
of customers is fixed, and this technique does not seem to be applicable. 

The importance of the Poisson Hypothesis as the central problem of the 
theory of large queueing systems was emphasized, among others, by Roland 
Dobrushin |D2j and Alexander Borovkov [Bj. 

The organization of the paper is the following: 



In the next Section |21 we introduce notation used in the rest of the paper. 
We formulate the properties needed of the distribution of the service time r) 
- the main parameter of our model. 

In the Section El we recall more results of the paper |KRlj . 

In the next Section 0] we formulate out main result. 

In Section we derive the self-averaging relation (Q), our key tool in 
establishing the Poisson Hypothesis. This is a statement about single server 
queue, M (t) /GI/1, in queueing theory jargon. This and the next sections 
are self-sufficient, and there we do not need any condition at all on the service 
time distribution. 

The Section [Ul contains the proof of a combinatorial statement dealing 
with the rod placements on M^. It is a key statement used in the previous 
section. It seems also to be of independent interest. 

In the next Section [7| we have collected various technical statements and 
estimates used in the sequel. Again, some of them, - for example, the calculus 
Lemma IT^ - seem to be of independent interest. 

The Section |S1 contains the derivation of the noisy version of the self- 
averaging relation (Q) - the relation (j26|) . Again, it uses the combinatorial 
statement of the Section IHl 

In Section El we consider a simplified case of our theory, when there are 
infinitely many servers at each node, so there are no queues. This case is 
presented for pedagogical reasons only. It can be analyzed by application 
of renewal theory and proving the Local Limit Theorem for i.i.d. random 
variables. 

In the next Section ^1 we explain that in more realistic situation one 
needs the Local Limit Theorem for Markov chain, instead of i.i.d.-s, but we 
show that it does not hold in general, so the analog of the renewal theory 
needed there does not exist as well. This is why the rest of the paper uses 
the analytic methods quite a bit. 

The next three Sections ITTl 1121 and IT^ contain the main step of our proof: 
the derivation of the relaxation property from the self-averaging relation. The 
Section ^2 deals with the case of finite range averaging kernels, the Section 
IT^ - with the infinite range kernels, while the Section ^1 - with the noisy 
case. As we proceed from easier cases to more difficult, the generality of our 
theorems becomes less and less. 

The last Section ^^ contains some conclusions and lists possible directions 
of further research. 



The reader who wants to go directly to the proof of the general result, 
can jump from Section |S1 straight to Section 112. II and then to Section IT^ 

2 Notation 

In this section we will fix the notation for the non-linear Markov process, 
which describes a given server in the above described limit. 

Server. It is defined by specifying the distribution of the random serving 
time rj, i.e. by the function 

F (t) = Pr {serving time 1] < t} . 

We suppose that rj is such that: 

1. the density function p{t) of r] is positive on t > and uniformly 
bounded from above; 

2. p{t) satisfies the following strong Lipschitz condition: for some C < oo 
and for all t > 

\pit + At)-pit)\<Cp{t)\At\, (8) 

provided t + At > and |At| < 1; 

3. introducing the random variables 

V = [v ~ '^ '7>t),t>0, 
we suppose that for some 6 > 0, Mg^r < oo 

2+5 



E(^r/ J <Ms,r. (9) 

Of course, this condition holds once 

Ms = E{7]f^^ <oo. (10) 

In what follows, the function 

Rr,iT)=E(ri ) < oo (11) 
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will play a crucial role. In particular, if 

Rr, (r) < C (12) 

for all T > 0, then PH holds for every initial state, as we will explain 
later. However, the condition ()12j) is too restrictive; it implies that the 
random variable 77 has some exponential moments finite (though the 
opposite is not true). Generally we are not assuming (fT^ . 

4. Without loss of generality we can suppose that 

E(r/) = 1. (13) 

In what follows, the function p (■) will be fixed. 

The remaining two conditions will not be used explicitly in the present 
paper. However we have to impose them since they are used in the 
paper |KRlj . while we are using its results: 

5. the probability density p (t) is differentiable in t, with p' (t) continu- 
ous. Moreover, introducing the functions Pr (t) as the densities of the 

random variables 77 , we require that the function pr (0) is bounded 

r 

uniformly in r > 0, 

PriO)<Uir]), (14) 

while the function ^p,- (0) is continuous and bounded uniformly in 
r > 0; 

6. the limits limT-_,ooPr (0) , lim^^oo j;:Pt (0) exist and are finite. 

Configurations. By a configuration of a server at a given time moment 
t we mean the following data: 

• The number n > of customers waiting to be served. The customer 
who is served at t, is included in the total amount n. This quantity n 
will be called the length of the queue. 

• The duration r of the elapsed service time of the customer under the 
service at the moment t. 
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Therefore the set of all configurations Q is the set of all pairs (n, r) , 
with an integer n > and a real r > 0, plus the point 0, describing the 
situation of the server being idle. For a configuration cj = (n, r) G f2 we 
define A^ (u) = n. We put N (0) = 0. 

States. By a state of the system we mean a probability measure n on Q. 
We denote by Ai [Q) the set of all states on Q. 

Observables. There are some natural random variables associated with 
our system. One is the queue length in the state /i, N^ = N^ (u) . We denote 
by A^ (/i) the mean queue length in the state /i : 

iV(^)=E(iV^)^(iV^M)^, 

and we introduce the subsets A^, (Q) C Ai (Q) , g > by 

Mg (n) = {fieM{n):N (/i) = q} . 

Another one is the expected service time S*^, corresponding to the function 

ioT u = 0, 



1 (n — 1) + i?^ (r) for LU = (n, r) , with n > 0. 

Again, we define 

^(/i)=E(^,) = (^M)^. (15) 

Clearly, if the condition (jl2|) holds, then 

5 (^) < CAT (/i) , (16) 

and therefore 5* (/i) is finite once /i G TWg (Q) for some q. In general, the 
expected service time 5* (/i) can be infinite for some states /i. These are the 
states for which PH can be violated, as we explain in jRSj . 

Input flow. Let a function A (t) > is given. We suppose that the 
input flow to our server is a Poisson process with rate function A (t) , which 
means in particular that the probabilities P^ [t, s) of the events that k new 
customers arrive during the time interval [t, s] satisfy 

( A(t) At + o(At) for k = l, 

Pfc (t, t + At) = <j 1 - A (t) At + o (At) for A; = 0, 

[ o (At) for A; > 1, 

as At -^ 0, while for non-intersecting time segments [ti, si] , [t2, S2] the flows 
are independent. 
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Output flow. Suppose the initial state u = fi{0) , as well as the rate 
function A (t) , with A (t) = for t < 0, of the input flow are given. Then the 
system evolves in time, and its state at the moment t is given by the measure 

In particular, the probabilities Qk (t, s) = Qk (t, s; z/, A (■) ,p (■)) of the events 
that k customers have finished their service during the time interval [t, s] are 
defined. We suppose that the customer, once served, leaves the system. 

The resulting random point process Q. (■, ■) need not, of course, be Pois- 
sonian. However we still can define its rate function b (t) as the one satisfying 

b{t)At + o{At) ioTk = l, 

Qk{t,t + At) = { l-b{t)At + o{At) for A; = 0, 

o (At) for A; > 1, 

as At ^ 0. The rate function 6 (■) of the output flow is determined once the 
initial state z/ = /i (0) and the rate function A (■) of the input flow are given. 
Therefore the following (non-linear) operator A is well defined: 

b{-) = A{u,X{-)). 

We will call the general situation, described by the pair z/, A (■) , and b (■) = 
A (z/, A (■)), as a General Flow Process (GFP). (This time inhomogeneous (lin- 
ear) Markov process is usually labelled in queueing theory by M(t)/GI/l.) 
The following is known about the operator A, see |KRlj : 

• For every initial state u the equation 

A{u,X{-)) = X{.) 

- in words: the rate of the input equals the rate of the output - has 
exactly one solution A (■) = Aj, (■) . Then the evolving state fiu,x^{-) (t) 
is the non-linear Markov process, which we will abbreviate as NMP. 

• This non-linear Markov process has the following conservation prop- 
erty: for all t 

N (/i.,A.(-) (t)) = N (z/) 

(because "the rates of the input flow and the output flow coincide"). So 
the spaces A^g (Q) are invariant under non-linear Markov evolutions. 
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• All the functions \u{-) are bounded: 

\At)<C = Cir]) (17) 

uniformly in z/ and t. (This is clear, since the output flow has its rate 
uniformly bounded, by the constant U [rj) , see ()14|1 . So (fTTj) holds with 

• For every constant c G [0, 1) there exists the initial state z/^, such that 

A{u„c) = c. (18) 

(Here we identify the constant c with the function taking the value c 
everywhere.) Moreover, this measure z/^ is a stationary state: fi^^^c [t) = 
i>c for all t > 0. The function c -^ N (z/^) is continuous increasing, with 
N (uq) = 0, N (z/c) t oo as c ^ 1. 

The non-linear Markov process iJiv,\^{.) [t) is the main object of the present 
paper. Therefore we will give now another definition of this process, via jump 
rates of transitions during the infinitesimal time. At. So suppose that our 
process is in the state n E M. {Vt) , and assumes the value u = (n, r) G Q. 
During the time increment At the following two transitions can happen with 
probabilities of order of At : 

• the customer under the service will finish it and will leave the server, 
so the value u = {n, r) will become (n — 1, ^) , with <;" < At. The 
probability of this event is 

ci At + o (At) , 

where 

Ci — Ci [LU — nm — — — Too — , , , — , 
At~*o At j^ p (x) dx 

while for cu = we put ci (0) = 0; 

• a new customer will arrive to the server, so the value uj = [n, r) will 
become (n + 1, r + At) . The probability of this event is given by 

CaAt + o (At) , 
14 



where the rate C2 depends on the whole state /x, and does not depend 
on oj : 

C2 = C2 (/i) = E^ (ci (cj)) . 

In words, the input rate is the average rate of the output in the state 



It is curious to note that while for the general nonlinear continuous time 
Markov processes its rates depend both on the configuration and on the state 
of the process, in our case the rate Ci depends only on the configuration, while 
the rate C2 - only on the state of the process. 



3 More facts from [KRl] 



Consider the following continuous time Markov process 971. Let there be 
M servers and A^ customers. The serving times are i.i.d., with distribution 
f]. The configuration of the system consists of specifying the numbers of 
customers n,, i = 1, ..., M, waiting at each server, plus the duration r^ of the 
service time for every customer under service. Therefore it is a point in 



e 



M,N 



= {{ui,...,ujm) e nfi^a : n^ + ...+nM = N] 



Upon being served, the customer goes to one of M servers with equal prob- 
ability 1/M, and is there the last in the queue. 

The permutation group Sm acts on Qm,n, leaving the transition proba- 
bilities invariant. Therefore we can consider the factor- process. Its values are 
(unordered) finite subsets of Q. It can be equivalently described as a measure 



^ ~ TJ^^i^^'n) 



i=l 

We will identify such measures with the configurations of the symmetrized 
factor-process. Note that 

So if we use the notation Aip (Q) C Ai (Q) for the measures fi onQ for which 
(n), = p, then we have that u E M.n_ (Q) . We also introduce the notation 

A* M 
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M.N_j^[Q) c TWjv (Q) for the family of atomic measures, such that each 

atom has a weight jj for some integer k. 

A state of our Markov process is a probabihty measure on the set of 
configurations, i.e. an element of A^ (A^ {Q)) . If the initial state of the 
process is supported by Aip (fi) , then at any positive time it is still the 
element of M {Mp {fi)) ■ A natural embedding M (fi) C M {M {fl)) , which 
to each configuration u E Ai (il) corresponds the atomic measure Si,, will be 
denoted by 6. 

For fiQ = 5y E M. [Aijt j^^ (f2) ) to be the initial state of our Markov 

process, we denote by fit the evolution of this state. (Clearly, in general 
fit ^ S i-M. (fi)) for positive t.) This process is ergodic. We denote by nM,N 
the stationary measure of this process. 

Let now k, E Aip (Q) be some measure, let the sequences of integers 
Nj, Mj — > oo be such that jf- ^ P, and let the measures u^ E Ai n^ (fi) be 

such that Uj -^ k weakly. Consider the Markov processes jil E M. \ A4.nj (fi) 

corresponding to the initial conditions 5yi. As we just said, in general pi ^ 

5 \ M. Nj [Vt) ) for each j, once t > 0. However, for the limit pt = linij-^oo Pt 

we have that pt E M. {M.p (fi)) , and moreover pt E 6 {M.p (fi)) , so we can 
say that the random evolutions pi tend to the non-random evolution fit with 
fiQ = K, as Nj, Mj — * oo. 

Therefore we have a dynamical system 

Tt:Mp{n)^Mp{n). (19) 

This dynamical system fit is nothing else but the non-linear Markov process, 
discussed above. 

Another way of obtaining the same dynamical system is to look on the 
behavior of a given server. Here instead of taking the symmetrization of the 
initial process 971 on Qm,n, we have to consider its projection on the first 
coordinate, Qi, say. To make the correspondence with the above, we have to 
take for the initial state of this process a measure u^ on Qm,n, which is Sm- 
invariant, and which symmetrization is the initial state u^ of the preceding 
paragraph. The projection of 9Jt on Qi would not be, of course, a Markov 
process. However, it becomes the very same non-linear Markov process pt in 
the above limit Nj, Mj -^ oo. 
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We can generalize further, and study the projection of !H to a finite 
product, n^=i^j- Then in the hmit Nj,Mj — > oo this projection converges 
to a process on 11^=1 ^i 5 which factors into the product of r independent 
copies of the same non-hnear Markov process /ij. This statement is known as 
the "propagation of chaos" property. 

The main result of the present paper is in particular to give conditions 
under which for every p the dynamical system (J19j) has exactly one fixed 
point Uc, c = c (p), and that it is globally attractive. That would imply that 
'^Nj,Mj ~^ ^c, provided -^ — *> p as j — *> 00 and c = c{p) . 

4 Main result 

Our main result states that under certain restrictions PH holds. In view of 
what was said in the beginning of the Introduction, it is sufficient to prove 
the following: 

Theorem 1 Consider the system, described in the Section and let its 
service time rj has properties 1-6 of this Section. For every initial state v 
with finite expected service time and finite mean queue: 

S{u)<oo, N{u)<oo, (20) 

the solution Xu{-) of the equation 

A{u,X{.)) = X{-) 

has the relaxation property: 

Xu {t) —^ c as t ^ 00, 

where the constant c satisfies 

N (z/) = E, {N (u)) = N (z/J = E,, {N (u)) . 

Moreover, fiu,\^{-) (t) -^ Uc weakly, as t ^ 00. 

In particular, if the service time r] has the property that i?^ (r) < C for 
all r (see (fT^ ). then the relaxation property holds for every initial state u. 
A special case of the above theorem is the following 
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Proposition 2 Let T > be some time m,om,ent, and suppose that the func- 
tion A (•) satisfies 

X{t) = b (t) for all t > T, (21) 

where 
Suppose that 

Then for some c > 



6(-) = A(0,A(-)). (22) 

/ X (t) dt<C <oo. 
Jo 

\{t) ^ c as t ^ oo. (23) 



Our theorem follows from the Proposition |21 immediately in the special 
case when the initial state u is of the form u = /io,A(-) (t) for some A and some 
t > 0. These initial states are easier to handle, so we treat them separately. 

The heuristics behind the Proposition |21 is the following. One expects 
that if 

6(-) = A(z.,A(-)), 

then the function b for large times is "closer to a constant" than the function 
A. More precisely, if t belongs to some segment [Ti,T2], with Ti S> 1, then 
the dependence of b [t) on z/ is very weak, so b is determined mainly by 
A. One then argues that once the segment [Ti,T2] is large, sup^g^j.^ j.^] ^ (^) 
should be strictly less than sup^gjj.^ j.^] -^ (^) • Indeed, one can visualize the 
random configuration of the exit moments yi-s as being obtained from the 
input moments configuration of Xj-s by making it sparser. Namely, we have to 
consider a sequence rji of i.i.d. random variables, having the same distribution 
as rj, and then to shift the particles Xi to the right, positioning them at 
locations 2;,-, so that in the result 
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Zi+i - Zi>7]i (24) 

for all i-s, and Hi = Zi + rji. Note that before the shift it might have been that 
Xi+i — Xi < rji for some is, see (jSH), (jH^ below for more details. However this 
is a very rough idea, since some particles need not be moved, due to the fact 
that Xi+i — Xi > rji may hold already before to the sparsening step, in which 
case it will happen that Zj+i = Xi+i, while Zi > Xi, and so the configuration 
becomes locally denser. (And if A is a constant, then b is this same constant, 
so again the above argument is not literally true.) 



To be more precise, we will show the following self-averaging property. 
Let the functions A (■) and 6 (■) are related by 

b{-) = A{0,X{.)). 

One of the main points of the following will be to show that for every value 
X one can find a probability density gA,x (t) , vanishing for t < 0, such that 



[X 



[A * gA,J (x) . (25) 



We then will show that this self-averaging property of the system implies 
(|23|l . provided we know in advance certain regularity properties of the family 
{(lx,x}- Note that apriori the condition (|25p is not evident at all for our FIFO 
(=First-In-First-Out) system: one has to rule out the situation that, say, 
the input rate function A is uniformly bounded from above by 1/3, while the 
output rate b is occasionally reaching the level 2/3; this is clearly inconsistent 
with (OK|l . 

In general case, when 

6(-) = A(/i,A(-)) 
and S (/u) < oo, we have 

b (x) = (1 - £:a,m (x)) [A * gA,M,x] (x) + Ex,^ {x) Qa,m {x) , (26) 

where ^a,^ {x) > 0, ex^^ (x) ^ as x ^ cxo, while Qa,/^ (x) is a bounded term, 
see Section IHl for details. 

5 The self- averaging relation 

Here we will derive a formula, expressing the function 6 (■) = A (0, A (■)) in 
terms of the functions A (■) and the density p (■) of 77. This will be the needed 
self- averaging relation (|^. 

First, we define the kernels qx,x (t) . To do it, let e (u) be the probability 
that our server is idle at the time u. (Note that the dependence of e (u) on 
A is only via {A (s) ,s < u} .) Now define the function c {u, t) as follows. Let 
us condition on the event that the server is idle just before time u, while at 
u the customer arrives. Under this condition define 

. ( the server is never idle during [u,u + t] ; 
c (m, t) = lim — Pr < during [u + t,u + t + h] the server gets ^ . (27) 
(^ through with some client 
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Then 

gA,x(t) = e(x-t)c(x-t,t). (28) 

Theorem 3 Let the functions b (•) and A (■) are related by 

b{-) = A{0,X{-)). 
Then also 

poo 

b{x)= \{x-t) qx,, (t) dt. (29) 

Jo 

Moreover, for all A, x 

poo 

/ qx,x (t) dt < 1. (30) 

Jo 

Note. The relation (jHU)) is not at all obvious, and we see no way to derive 
it from (PHj) without going into the details of the serving mechanism. In fact, 
it does not hold for some more general models. 

Proof. We first introduce some new notions. 

Let li,...,ln > be a collection of positive real numbers, which we will 
interpret as the lengths of hard rods (=service times), placed in M^. A con- 
figuration of rods can be then given by specifying the sequence xi,X2, ...yXn 
of their left-ends: the rod k occupies the segment [xi,Xi + k] . This configu- 
ration will be denoted by cr„ (xi, X2, ..., x„; /i, ...,/„) . 

In case some of the rods from cr„ (xi,X2, ...,x„; /i, ..., /„) are intersecting 
over a nondegenerate segments, we say that such a configuration has confiicts. 
By a resolution of confiicts we call another placement of the rods /i,...,/„ 
on the line. To define it, we first need to reenumerate the points of the 
sequence Xi,X2, ■■■,Xn so that it will become increasing. To save on notation 
we suppose until the end of this paragraph only that it is initially so. Then 
the new placing of the rods have the following sequence zi < Z2 < ■■■ < Zn oi 
the left-ends: 
it is defined inductively by 

Zl = Xi, 

and 

Zi = max{zi.i + li^i,Xi} (31) 

(Lindley equation). We will denote by y-s the corresponding set of the right- 
ends: 

yi = Zi + k. (32) 
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Any configuration with no conflicts, and in particular any conflguration ob- 
tained by resolution of the conflicting one, will be called an r-configuration. 
The operation of resolving the conflict will be denoted by R, so 

(^n \^lj ^2? •••; ^m I'ly •••; 'nj -txCfi \Xi, X2y •••, Xfij 'l, •••, I'n) ■ 

(The /^-operation is not well deflned for a;-sequences with coinciding entries. 
However, they have zero Lebesgue measure, which makes them irrelevant for 
our future needs.) 

For any conflguration a of rods we will denote by Y (a) the set of their 
right-ends. So, in our notations 

{yi, ■■■,yn) =y {R<^n {Xl, X2, ..., Xn, h, ..., Q) ■ 

Suppose now that the lengths /i, ..., /„, the set Xi, 0:2, ..., a;„_i (with n— 1 
points) and the location 1/ G M^ are specifled. We deflne the values X (y) = 

X iy xi,X2, ■■■,Xn-i',h, ■■■, In) G M^ as the solutious of the cquatiou 



y eY {Ran (xi, X2, ...,Xn-i, X (y) ; h, ..., /„)) . 



(33) 



It is clear that the function X (y 



xi,X2, ...,Xn-i',h, ■■■,hi) is not deflned 
everywhere, and on the set where it is deflned, it is multivalued, provided 
n > 2. (The case n = 1 is trivial: X (y lij = y — li.) However, outside the 

set of x-s and /-s of Lebesgue measure zero in M^"~^, which set is irrelevant 
for our future purposes, its multivaluedness is reduced to "flnitely-many- 
valuedness" . 

Now we can write the desired formula: 



00 _. 
b {y) = exp {-h {y)} J2 T^T^W 

n=l ^ '' 



X 



(34) 




/y py ^ 

... / X\x(y {xi,...,Xn~i};li,...Jn))Y\>^{xi) dx 



Y\_p{h) dli, 



i=l 



where 



hiy) 



y 
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A (x) dx. 



The integral in (|34p should be understood as follows: the range of integration 

coincides with the domain where the function X iy {xi, ..., Xn-i} ; /i, ..., /„ 

is defined, while over the domains where the function X is multivalued one 
should integrate each branch separately and then take the sum of integrals. 
In words, the meaning of the relation ()34|) is the following: for every 
realization xi, ...,Xn-i of the Poisson random field and every realization 
li, ...,ln of the sequence of the service times, we look for time moments X = 



x{y 



Xi, ..., Xn-i] h, ...Jn) 5 at which the /^-customer has to arrive, so as to 
ensure that at the moment y some customer (perhaps a different one) will 
exit, after being served. That is, moments X = X (y xi, ..., x„-i; /i, ..., /«) 
are beginnings of busy periods, during which there happens an exit at time y. 
In some cases such moments might not exist, while in other cases there might 
be more than one such moment. If Xj are these moments, we then have to 
add all the rate values, A (Xj) , and to integrate the sum J2i ^ i^i) over all 
n and all xi, ..., x„_i; h, ..., /„, thus getting the exit rate b{y) . A one-second 
thought will convince the reader that the formula (jMj) contains in itself an- 
other definition of the kernel (j28|) , together with the proof of the relation 
fOUj) . So we need only to prove (j^ , which turns out to be quite delicate. 

The first summand (n = 1) in the sum in ()34|) is by definition the convo- 
lution, 



bi{y) 



Since p (/) > and 






X{y-l)p{l) dl. 



p{l) dl< 1, 



(35) 



(36) 



we have indeed that 6i {y) < sn^i^^y A (x) in case when, say, the maxima of A 
are isolated, or when A is not a constant and the support of the distribution 
p is the full semiaxis {/ > 0} . We want to show that in some sense the same 



is true for all the functions 6„, defined as 



bn{y) 
Since 



A X h/ 



Xi, ..., Xn_i, ii. 



...,.)) n (III-. 



h{y) 



n-l 



h{y)=ew{-h{y)]Y.j^^h^{y) 



n=l 



\{p{i:)dk 



i=l 



(37) 
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the crucial step will be the analog of (jH3j) . (jHB|) for all n > 1, that is that 



bniy) 



>^{y -l)Pn{l) dl, 



for some Pn (1) > 0, Jq Pn (0 dl /" 1 ioi y ^ oo. This turns out to be quite 
an involved combinatorial statement. 

Note that, evidently, the measure nr=iP(^i) ^^i ^^ invariant under the 
coordinate permutations in M"; therefore we can rewrite the expression (|37|) 
for the function bn{y) as 



bn{y) 



^.^(H^ 



n-l 



Xi, ..., Xr, 



^i;{/i,...,/n}))n(r^^^' 



j=l 



(y) 



l[p{k)dk 



j=i 



(38) 



xi,..., Xn-i] {h, ..., In}) by definition 
assigns to every y the union of the sets of solutions X {y) of all the 
equations 



where the following notations and conventions are used: 



the (multivalued) function X ( y 



y eY [Ran (xi, ...,x„_i,X (y) ]K{i), ...,K(n))) 



(39) 



with TT running over all the permutation group iS„ (the notation {/i, ..., /„} 
stresses the fact that the function X does not depend on the order of 

/i-s); 



the entries of the set X f y xi, ...,Xn-i', {h, ...,/„}) have to be counted 

with multiphcities, which for a given x E X iy Xi, ..., x„_i; {h, ..., /„} 

is by definition the number of equations ()39|) with different vr-s, to which 
X is a solution; 



• the integration in (j58|) of the multivalued function means that each 
sheet should be integrated and the results added. Moreover, each sheet 
has to be taken as many times as its multiplicity is. 

Since each contribution X (X (y xi, ...,x„_i; /i, ..., /„ j j to (jHTj) appears 
n! times in (jHHj) , we have to divide by n\. 



23 



We repeat that while for some x-s, vr-s and l-s the equation (|39|) might 
have no solutions, for other data it can have more than one solution. Clearly, 

the set X (y xi, ...,x„_i; {/i, ..., In}), for Lebesgue-almost every dataxi, ...,Xn-i, 

can have no other entries than those of the form 

XA,y,{k} = y- Yl ^^' 

JeAc{l,2,...,n} 

where A runs over all nonempty subsets of {1,2, ...,n} (i.e. at most 2" — 1 
different entries). So the function X (y xi, ...,x„_i; {/i, ...,/„}], as a func- 
tion of Xi, ...,Xn-i, has to be piecewise constant. It is not ruled out apriori 
that for some data the set X (y Xi, ..., Xn-i', {h, ■••, In} ) can be empty. This 
is not, however, the case. Moreover, as the crucial Theorem 0] below states, 

• the number of elements in the set X iy xi, ...,x„_i; {/i, ...,/„} j , counted 

with multiplicities, is precisely n\ for Lebesgue-almost every value of 
the arguments. 



Therefore we have for the inner integral in 



/ ^.^ (^ (^ h'' ■■■' ^"-'' ^^'' ■■■' ^"0) n (t^ ^^ 

f 1 "~^ /A 

^ h^, 5Z k{A,y,Xi,...,Xn-i;{ll,.-,ln})\{xA,y,{h})Yl[j 



A(xi) 






where the integer k {A,y,xi, ...,Xn-i', {h, ■■■Jn}) is the multiphcity of the 
value XA,y,{ii} of the function X at the point {y,xi, ...,x„_i; {h, ..., /„}) . Rewrit- 
ing it as 



—A (x (y xi,...,x„_i;{/i,...,/„}jj JJ ( TTT ^^' 

^C{l,2,...,n}, 
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where 



q\,y[A {li,...,ln}j 

= / ;^fc {A y, xi, ..., x„_i; {h, ..., /„}) JJ ( — A- dxi j 



(40) 



we have, due to the fact that Lebesgue-a.e. 



^ k{A,y,xi,...,Xn-i;{lu...,ln}) 



n\. 



Ac{l,2,...,n}, 



the relations 




<qx,y\^A {/i,...,Z„}j < 1, with ^ (l\,yy^ {/i,. ..,/„} j = 1, 



ylC{l,2....,n}. 



(41) 

since the measures yT) dxi are probabihty measures on [0, y]. (Note that the 
functions k (A, |/,Xi, ...,x„_i; {/i, ..., /„}) do depend on the variables Xi, ...,x„_i; 
hence the measures qx^y i ■ {/i, ..., /„} j indeed depend on A, y.) Therefore, for 
the function 6„ {y) we obtain a sort of a convolution expression: 



bn{y) 



/n 
J2 [(lx,y {a I {/i, ..., /j) A {xA,y,{h})] Ilpih) dli. (42) 

Acfl.2 n\. J=l 



ylC{l,2,...,n} 
A^0 



Be it the case that the probability measure q\^y (■ {/i,...,Z„}j is concen- 
trated on just one subset A = {1,2, ...,n} , we would obtain the usual con- 
volution 



iy) = l^iy 



h 



Q n^ (^^) dli = >^*p* ■■■*? (y) ■ 



i=l 



Here the situation is more subtle, and in ()42|) we have a stochastic mixture 
of convolutions with random number of summands. 

Taking into account the relations ((MI), P7|). ((121), ^^^ result can be sum- 
marized as follows. Let 9 = 6\^y be the integer valued random variable with 
the distribution 



Pr {e = n] = exp {-/a {y)} 



[h {y)T 



n\ 



n = 0,1,2,..., 
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and f]i,ri2, ... be the i.i.d. random serving times. Consider the random func- 
tion ^x,y = ^x,y {^\,y]Vi:V2, ■■■) , such that its conditional distribution under 
condition that the reahzation 9x^y; r^i, 772, ... is given, is supported by the finite 
set 






Li6x,y;vi,m, 
and is given by 

P^^ \ ^A.y = ^Vi\ dx,y; ??i, ??2, ••• > = q\,y (^ {vu -, Ve^,y+i}) 
I leA J 

(see (J4(J|) ). Then the following holds: 

6(y) = E(A(y-6,,)). 

This is precisely the relation (J2S1), with qxy being the distribution of ^a,j/- 
The relation (jHUj) follows directly from ()41|) . ■ 

6 Combinatorics of the rod placements 

In this section we will prove the Theorem HI which was used in the previous 
section. We will use the notation of the previous section, introduced in the 
proof of the Theorem IHl up to relation ^^ . 

By a cluster of the r-configuration cr„ (zi, ..., 2„; /i, ..., In) with zi < ... < Zn 
we call any maximal subsequence Zi < Zj+i < ... < Zj such that Zj = Zi + li + 
k+i + ... + lj-i. (The segment [z,, Zi + k + k+i + ... + lj] = [xj, Zj + Ij] is what 
is called "busy period" for the queue.) If Zi < Zi^i < ... < Zj is a cluster of an 
r-configuration, then the point Zi will be called the root of the cluster, while 
the point Zj will be called the head of the cluster. Note that for Lebesgue 
almost every configuration cr„ (xi, ...,x„; /i, ..., /„) the point Zi is a root of 
a cluster of the corresponding r-configuration if and only if Zi = Xj. The 
segment [zi, Zj + Ij] will be called the body of the cluster Zi < Zi^i < ... < Zj, 
and the point Zj + Ij will be called the end of the cluster. 

The notation a^ (xi, ..., x^; /i, ..., /„) U o"i (X, L) has the obvious meaning 
of adding an extra rod of the length L at the location X. Note though, that 
in general 

R [an (xi, ..., Xn] h, ..., In) U (Ti {X, L)] ^ R [Ran (xi, ..., Xn; h, ..., /„) U 0-1 (X, L)] 
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It is however the case, if the point X is outside the union of all bodies of 
clusters of Ran (xi, ..., x„; /i, ...,/„) . This will be used later. 

In what follows we will need a marked point in M^. For all our purposes 
it is convenient to chose the origin, G M^, as such a point. 

We will say that the resolution of conflicts in the configuration 
(Jn (xi, ..., Xn', 111 ■■■■, ^n) results in a hit of the origin, iff for some k we have 

yk = Zk + lk = 0. (43) 

Such a hit will be called an x^-hit, iff the cluster of the point z^ has its root 
at Zr = Xr- (Necessarily, we have that r < k.) An x^-hit will be called an 
(xr,Xfc)-hit, if fEH|) holds. 

Now we are ready to formulate our problem. Let n be an integer, and 
Ai < A2 < ... < A„ be a fixed set of positive lengths of rods. Let xi < X2 < 
... < Xn-i be a set of (n — 1) left-ends. We want to compute the number 
A^ (xi,X2, ...,x„_i; Ai, A2, ..., A„) , which is defined as follows. For any per- 
mutation TT of n elements and for any X G M}, X 7^ xi,X2, ...,x„-i we can 
consider the configuration cr„_i (xi, ...,Xn-i] A^(i), ..., Xn{n-i)) Uai [X, X^in)) 
of rods, when the rods k = A^(j) are placed at Xi,i = l,...,n — 1, while 
the free rod /„ = Xn{n) is placed at X. Given vr, we count the number 
A^^ (xi, ..., x„_i; Ai, ..., A„) of different locations X, such that the correspond- 
ing r-configuration R [a^-i (xi, ..., x„_i; A^(i), ..., A^(„_i)) U ai (X, A^(„))] has 
a hit, and moreover this hit is an X-hit. (In certain cases one cannot 
produce an X-hit by putting the rod /„ = A^(„) anywhere on M}; then 
X^ (xi, ...,Xn_i; Ai, ..., A„) = 0. In certain other cases there are more than 
one possibility to place the free rod so as to produce an X-hit.) Then we 
define 

N (xi, ...,x„_i; Ai, ..., A„) = 2_^ ^n {^1} ■■■^^n-i, Ai, ..., A„) . 

neS„ 

Theorem 4 For Lebesgue- almost every xi, ..., x„-i and Ai, ..., A^, 

N (xi, ..., x„_i; Ai, ..., A„) = n! 

Proof. Let us explain why the result is plausible. Let the set xi, ..., x„_i 
be given. Then we can choose the positive numbers Ai, ..., A„ so small that 
for any tt the configuration 
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cr„_i (a;i,...,x„_i; A^(i),...,A^(„_i))Ucri {X = -\n{n),K{n)) , having the (X, X)- 
hit, has no conflicts, while no other choice of X results in a hit. Therefore in 
our case N^, {xi, ..., Xn-i] Ai, ..., A„) = 1 for every vr, so indeed 
N {xi,...,Xn-i;Xi,...,Xn) = n\. 

Now we explain why our result is non-trivial. To see it, take n = 2, 
Xi = —3, Ai = 1, A2 = 10. Then 

A^i2(xi;Ai,A2) = 2 

- one can place the rod 10 at —10 or at —11. On the other hand, 

A^2i(xi;Ai,A2) = 

- the rod 10, placed at —3, blocks the origin from being hit. Still, 2 + = 2!. 
Note that this example is a general position one. 

We will derive our theorem from its special case, explained in the first 
paragraph of the present proof. The idea of computing X (xi, ...,x„_i; Ai, ..., A„) 
for a general data is to decrease one by one the numbers Ai < A2 < ... < A„, 
starting from the smallest one, to the values very small, keeping track on the 
quantities N^, {xi, ..., Xn-i] Ai, ..., A„) . During this evolution some of these will 
jump, but the total sum N {xi, ..., Xn-i, Ai, ..., A„) would stay unchanged, as 
we will show. That will prove our theorem. 

We begin by presenting a simple formula for the number Nt, (xi, ..., Xn-i, Ai, .., An) 
Consider the rod configuration R [o"„__i (xi, ..., x„_i; A7r(i), ..., A^(„_i))] , which 
will be abbreviated as i?^ (Ai, .., A^) = R-^ (A) . Let us compute the quantity 
5*^ (xi, ..., Xn-i] Ai, .., A„) , which is the number of points Hi eY (i?^ (Ai, .., A„)) , 
falling into the segment [— A7r(n), O] . 



Lemma 5 



Nn [Xi, ...,Xn-l', Ai, .., A„) 



if the point — A 






I Xn-l, Ai, .., An) 

, Xn-i; Ai, .., An) + 1 otherwice 



7r(n) 

belongs to a cluster 
of Rn (Ai, .., An) , 



(44) 



Proof of the Lemma [51 Indeed, for every i/i, falling inside [—\Tr(n), O] . 
there is a position 
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Xi{zi, ...,Zn-i,yi, ...,yn-i) < 0, such that once the free rod A^(„) is placed 
there, the site i/i is pushed to the right and hits the origin. In case the point 
— A^(„) is outside all clusters of R^ (Ai, .., A„) , placing the free rod Xn(n) at 
Xq = —Xn{n) produces an extra hit. ■ 
Now let A > be such that 

Ai < A2 < ... < X^-l <Ai-A<A, + A< A,+i < ... < A„ 

for some i = l,...,n, and some of the functions N^^ exhibit jumps in the 
variable Aj as it goes down from Aj + A to Aj — A. We denote by A (6) the 
vector Ai, ..., Aj + 6, ..., A„. We suppose that A is small enough, so that for 
any tt the difference 

|A^^ (xi, ..., x„_i; A (A)) - N^ (xi, ..., x„_i; A (-A))| 

is at most one. Moreover, we want A to be so small that on the segment 
A G [Aj — A, Aj + A] there is precisely one point, say Aj, at which some of 
the functions N.,, (xi, ...,x„_i; A) do jump. (In general, there will be several 
permutations tt, for which such a jump will happen at A = A,. Indeed, if we 
observe an (X, XA;)-hit in our rod configuration with k = Xn{i), while we have 
that Xi < X2 < ...Xs_i < X < Xs < ... < Xfc < ... < Xn-i, then in some cases 
we will have an (X, Xjt)-hit for every rearrangement of the rods Ig, ■■■,lk, i-e. 
for all permutations of the form vro p, where p permutes the elements s, ...,k, 
leaving the other fixed, see Lemma El) 
Let us begin with the case when 

N^ (xi, ..., x„_i; A (A)) - N^ (xi, ..., x„_i; A (-A)) = I. (45) 

That means that either the intersection Y {Rt, (A (A))) fl —A (A)^. -^ , is 

non-empty and after the 2(5-evolution its cardinality decreases by one, or 
else that the point —A (A)^/ ^ is outside all clusters of R-„ (A (A)) , while 
the point —X{—A),s is inside some cluster of i?^(A(— A)). In the first 
case let yk (A (A) , tt) < ... < yr {X (A) , vr) be all the points of the above 
intersection. The relation P3|) implies via pi|) that the point yk (A {6) , tt) 

leaves the segment —A {S)^,^ ,0 as 5 passes the zero value: 

l/,(A((5),7r)>-A(5)^(„) for5>0, (46) 

yk (A (0) , vr) = -A (0)^(„) , (47) 
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2/,(A(5),7r)<-A(5)^(„) ioT5<0. (48) 

Moreover, the point yk (A (6) , vr) is not the end of the cluster - otherwise 
we would have N^, (xi, ...,x„_i; A (A)) = iV^ (xi, ...,x„_i; A (—A)) . Therefore 
Uk (A (S) , tt) = 2:^+1 (A (5) , vr) . We now claim that if we assign the rod A (S),-. 
to Xk+i, and will take for the free rod the rod A (5)^(^+1), then for the corre- 
sponding permutation the opposite to (jl^ happens: 

A^^o(n^fc+i) {xi, •••, a;„_i; A (A)) - N^o(n^k+i) {xi, ..., a;„_i; A (-A)) = -1. 

(49) 
(Here we denote by vr o (n ^-* A; + 1) the permutation which is the compo- 
sition of the transposition n ^^ k + 1, followed by vr.) Indeed, after the 
above reassignment and the resolution of conflicts, the rod A {S)^/^\ will be 
positioned at the point i/k (A (6) , vr) . The relations (jiUll — (jiS|) then tell us 
that during the 2(5-evolution the right endpoint of this rod will move from 
the positive semiaxis to the negative one, thus adding one unit to the value 

Sno{n'^k+l) [Xl, ■■■, Xn-l', A (A)) . 

In the second case we have that the point —A (A)^/ -j is outside all clusters 
of i?7r (A (A)) , while the point —A (— A)^/ ^ is inside a cluster of R.,, (A (—A)). 
That however can happen only if tt (n) = i,so the rod A [S)^,^-. itself is varying 
with 6, and in addition to it we have for some k ^ n that 

{< Xk if (5 > 0, 
= x, if<5 = 0, 
> Xk otherwice, 

while A,r(fc) > —Xk- But then for a permutation tt o [n ^-^ k) we have that the 
variable rod Aj (6) is assigned to the location Xk, is not relocated due to the 
resolution of conflicts, so the endpoint i/k equals Xk + Xi (S) , and during the 
evolution crosses the zero threshold from right to left; therefore again 

^''7ro(n^fc) {Xl, ..., Xn-l] A (A)) - N^o{n^k) {Xl, •.., Xn-l] A (-A)) = -1. 

The above construction corresponds to every permutation tt, satisfying 
(j45|) , another permutation, tt' = $ (vr) , which satisfy (j49j) . We will be done 
if we show that $ is one to one. We prove this by constructing the inverse 
of $. 

So let vr' be such that 

N^> (xi, ..., Xn-i] A (A)) - N^> (xi, ..., x„_i; A (-A)) = -1. 
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That means that the cardinahty of the intersection Y {Rt,i (A (A)))n —A (A)^,/ -j , 
increases by one during the 25-evolution: indeed, the only other option, 
due to the Lemma is that the point —A {/S)^,,. is inside some clus- 
ter of i?7r' (A (A)) , while the point —A {—/S)^,,. is outside all clusters of 
R^i (A (—A)) . But in this case N^,/ (xi, ..., x„_i; A (A)) = N^,/ (xi, ..., x„_i; A (—A)) . 

In our situation we necessarily have that the intersection Y (i?^/ (A (A)))n 
(0, +oo) 7^ 0. Let yk' (A (A) , tt') < ... < y,.' (A (A) , tt') are all the points of this 
intersection. The relation (jl^j) implies via (ji^ that the point yu' (A {5) , vr') 
moves from the positive semiaxis to the negative one as 6 passes the zero 
value: 

yk' (A (6) , tt') > for 6 > 0, (50) 

l/fc.(A(0),7r')=0, (51) 

yk, (A (6) , tt') < for 6 < 0. (52) 

Two subcases are possible. The first one is when the point Zk' is the head of 
the cluster, so Zk' = Xk', and the rod A7r'(fc') is the variable one. Then for the 
permutation tt" = tt' o [n ^^ k') the following happen: the free rod A^//(n) is 
the variable one, and as 6 varies, the point — A,r"(n) nioves from the location 
to the left of Xk' to the location to the right to Xk> ■ Since the point Xk' is the 
head of the cluster, we have therefore that 

N^,, (xi, ..., a;„_i; A (A)) - N^. (xi, ..., x„_i; A (- A)) = 1. (53) 

In the second subcase Zk' = yy-i- Then the relations (j5(Jj) — (j52j) mean that 

the point yk'-i (A (5) , tt') is inside the segment —A {d)^,,^,-. ,0 for 5 = A, and 

outside it for 5 = —A. So if we again assign the free rod A (S)^,,. to the point 
Xk', making instead the rod A ((5)^,/^,-| to be free, then for the permutation 
tt" = tt' o (n ^^ k') = $' (tt') the relation ()53p again holds. 

The statement that $' is inverse to $ is straightforward. ■ 
Below we will need a version of the above theorem, which follows. Let T, L 
be positive real, L < T. Let again n be an integer, and Ai < A2 < ... < A„ 
be a fixed set of positive lengths of rods. Let —T < xi < X2 < ■■■ < 
Xn-i < be a set of (n — 1) left-ends. We want to compute the number 
N (— T, xi, X2, ..., Xn_i; L, Ai, A2, ..., A„) , which is defined as follows. For any 
permutation tt of tt, elements and for any X G (— T, 0) , X ^ Xi, X2, ..., x„_i we 
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can consider the configuration (T„ (— T, xi, ..., x„_i; L, Xnii), •••, A7r(„_i)) Uai (X, A,r(n)) 
of rods, when the rod L is placed at — T, the rods /j = A^(j) are placed at 
Xj, i = 1, ..., n — 1, while the free rod In = X-Trin) is placed at X, —T < X < 0. 
Given vr, we count the number N^, {—T, Xi, X2, ..., a;„_i; L, Ai, A2, ..., A^) of dif- 
ferent locations X, such that the corresponding r-configuration 
R [an (-T, Xi, ..., x„_i; L, A^(i), ..., A^(„_i)) U ai (X, A^(„))] has a hit at zero, 
and moreover this hit is an X-hit. Then we define 

X (— T, Xi, X2, ..., Xn-l] L, Ai, A2, ..., An) = 2_^ ^T (~^5 ^l5 2^2, •••, Xn-l] L, Ai, A2, ..., A„) . 

nGSn 

Theorem 6 Suppose that 

L + Ai + A2 + ... + A„<r. (54) 

Then N (— T, xi, X2, ..., x„_i; L, Ai, A2, ..., A„) = n\ for Lehesgue- almost every 
xi,...,x„_i and Ai, ..., A„. 

The Theorem [B] differs from the Theorem 0] by the presence of the addi- 
tional rod L, which is placed at — T, and by the restriction that all points 
X, xi, X2, ..., x„-i has to be within the segment (— T, 0). In particular, the 
rod L does not have to move under the resolution of conflicts. 

Note that without the restriction (j3^ the statement of the theorem is 
not valid, as it is easy to see. 

Proof. Let the numbers < £1 < ... < Sn-i be so small that the sum ei + 
...+en~i is less than any of the numbers \5q (T — L) + 6i\i + 62X2 + ••• + SnXn\ , 
where Si are taking any of three values —1,0,1, with the only restriction 
that not all of them vanish simultaneously. Let us replace the conflguration 
Xi,X2, ...,Xn-i by the conflguration x[,X2, ...,x^_;^, where 

, _ ( L-T + Ei iixi< L-T, 
* 1^ Xj otherwice. 

Let k be the largest integer for which x^ > Xj. (The meaning of the conflg- 
uration x'^,X2, ...,x'^_i is the following: were all e, zeroes, it is the result of 
resolving the flrst conflict, between the flrst rod L and the rods intersecting 
it, which rods have to be pushed to the right-hand end of L. We use positive 
e-s in order to have all the point x^ different.) By the previous theorem we 
know that X (x'^, X2, ...,x'„_]^; Ai, ..., A„) = n! . Let the location X and the 
permutation vr are such that the corresponding r-conflguration 
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R[(Tn-i (a;i,...,x^„i; A^(i),...,A^(„_i)) U ai (X, A^(„))] hasanX-hit. The con- 
dition (jH^ implies that the cluster of the r-configuration 
R [(Xn-i {x[, ..., <_i; A^(i), ..., A^(„_i)) U (Ji (X, A^(„))] , rooted at X, does not 
contain any of the points z[ = x[, z'2, ...,z'j^ (see (j^ for the notation), so 
X > L — T, and the r-configuration 

R [cTn {-T, Xi, ..., x„_i; L, A^(i), ..., A^(„_i)) U ai [X, Xn(n))] has an X-hit as 
well. Therefore 

X (— T, a;i,a;2, ...,x„_i; L, Ai, A2, ..., A„) > n! . On the other hand, if the r- 
configuration 

R [an (-T,xi,...,x„_i;L, A^(i),...,A^(„_i)) U cri (X, A^(„))] has anX-hit, then 
by the same reasoning X has to be to the right of the location L — T, and 
moreover the cluster of this configuration, rooted at X, does not contain any 
of the points zi = — T, Z2 = —T + L, ..., Zk+u therefore the r-configuration 
R [a„_i (x'l, ..., x^_i; A^(i), ..., A^(„_i)) U ai (X, A^(„))] has an X-hit. Hence 
X (— T, xi, X2, ...,Xn-i', L, Ai, A2, ..., A„) < n\ , and the proof follows. ■ 

7 10 (ten) technical statements 

In this section we present several technical statements needed for the proof 
of our main result. The first subsection deals with the regularity properties 
of the NMP-s, while the second - with the estimates on the averaging kernels 

7.1 Regularity properties of Non-Linear Markov Pro- 
cess 

The first fact we will establish concerns the integral behavior of the output 
rate (=input rate) of the NMP. 

Lemma 7 Let fiu,x,(.) (■) be NMP, with N {nu,xA) (^)) = N (u) = q. Then 
there exists a time duration T' = T' (q) and e' = e' (q) > 0, such that for all 
T>T' and all s > 

rs+T 

/ X^{t) dt<T{l-e'). (55) 

J s 

Clearly, in order to see it, it is sufficient to prove the following statement: 
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Proposition 8 Let fit be GFP (i.e. time inhomogeneous Markov process 
M(t)/GI/l, see Sect. 2) with arbitrary initial state /io, corresponding to the 
Poisson input with continuous rate A (t) , < A (t) < L. For any N > one 
can find e {N) and T {N, L) , such that if for some T >T {N, L) 

f \{t)dt> {l-e{N))T, (56) 

Jo 

then for some t <T 

Nifit)>N. (57) 

Indeed, if for any T and e' one can find s sucli tliat (j33j) is violated, tlien 
Proposition ISl used with L = C (rj) (see (HZj)), would imply that the function 
N {fiu,x^{-) (t)) is unbounded. This, however, contradicts to the fact that it 
stays constant. The continuity of A^ (t) , which is a prerequisite needed to 
apply Proposition |H1 is a consequence of Lemma ^^ below. 

The proof of the Proposition |H1 (which proposition is of course valid even 
without continuity assumption) follows from the next two lemmas, preceded 
by two definitions. 

Let Xi) X2 be two measures on a segment [A, B] C R^ 

Definition 9 We say that xi -< X2, if for any monotone increasing function 
f on [A, B] we have 

pB pB 

/ f dxi< f dx2- 

J A J A 

(This is equivalent to saying that xi([a, 5]) < X2([a.,-B]) for every h e 
[A^B].) 

Definition 10 We say that xi < X2 if for every positive function g on [A, B] 
we have 

B j-B 

g dxi< g dx2- 

A J A 

(This is equivalent to saying that xi(['^j^]) ^ X2 ([«,&]) for every a,b & 
[A, B] .) Note that the second relation holds for probability measures only 
in case when xi = X2', in this paragraph we are concerned, however, with 
arbitrary measures. 

In what follows we will assume that the measures Xi have densities Aj 
with respect to the Lebesgue measure, which densities are continuous and 
satisfy < Aj < C, though much of what will be said is true in more general 
situation. 
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Lemma 11 Let us consider two GFP (non- stationary Markov processes) 
fj'l, fj'f, with the same distribution of the service time rj, and with the Poisson 
input flows, defined by the two measures X11X2 on the time interval [A,B\ . 
Suppose that fi\ (0) = 1 (that is, the first server is initially idle), and that 
Xi ^ X2- Then 

N (/x^) < N (/i|) . 

Proof. The rough idea of the proof is the following: we will argue that 
the condition Xi ~< X2 enables us to represent the process fif as a certain 
transformation of the process fi], when the customers of the second process 
are the same as these in the first process (i.e. they require the same service 
times), but just come later, in addition to extra customers which were not 
present in the first process. Clearly, in that case the queue at the final 
moment has to be longer for the second process. 

To make the above rigorous, we will use the coupling technique. Note 
first, that if P is a Poisson random field on [A, -B] with the rate function 
A (t) , t G [A,B],uj C [A, B] is its realization, and / : [A, B] ^ [A, B] 
is a strictly increasing continuous map, then the image set / (uj) is also a 
realization of a Poisson random field P-^, defined by the rate function A'^ (t) , 
given by 

,/(() = / ^ipS ifte/([-4,Bl), 

y otherwice. 

We claim now that if Xi ^ X2, then there exists a map / : [A, B] -^ [A, B] , 
such that 

f (x) > X for all X G [A, B] , 

A{ (t) < A2 (t) . 

One way to construct such a function is the following. Let us extend the 
function A2 (t) to the region t > -B by putting it there to be equal to maxAi. 
Consider now the family $ of all continuous functions (/? : [A, 5] -^ [A, 00), 
satisfying the properties: 

ip (x) > X] 

viy) ^ V (^) for y > x; 
Ai(a;) 



ip'{x) 



<A2(^(X)). 
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For example, any shift ipc {x) = x + c is in $, once c > -B — A, so $ is non- 
empty. Note that if v'l, v^2 ^ ^, then the function (p {x) = min {ipi (x) , (p2 (x)} 
is also in $. Therefore the function 

f{x) = ini {<^{x)} 

is in $ as well, and it is easy to see that f ([A,B]) C [^, -B] • (In fact, if 
X2 {[-A, B]) = Xi ([^5 B]) , then / is the only function in $ with this property.) 

Another, more intuitive way of defining /, is by constructing a coupling 
between the measure xi and a suitable measure xs ^ Xij which is a "part" 
of X2, in the sense that Xs ^ X2- (The measure K on [A, B] x [A, B] is called a 
coupling between the measures x' ^^^ x" o^^ [^5 B] iff for every subset C C [A, B] 
we have K {C X [A, B]) = x' (C) and K {[A, B] X C) = x" (C) .) 

The special coupling we need can be most easily constructed via discrete 
approximations of the measures Xi and subsequent limit procedure. Since this 
construction is well-known due to extensive use in probability theory of the 
Monge-Kantorovich-Rubinstein-Ornstein-Vasserstein distance, we will give 
only a sketch of it. We replace the segment [^, -B] by the set {1,2, ...,n} C 
M}. The coupling sought is then just a matrix K {i,j) . We construct it by 
induction. 

We define the first row K (l,-) = {K {1,1) , K (1,2) , ..., K (1, n)} to be 
the measure on {1,2, ...,n} with the following properties: 

i)ir(l,l)+i^(l,2) + ... + i^(l,n) = Xi(l); 

ii)i^(l,-)<X2(-); 

iii) K (1, ■) is the minimal (in the -<-sense) measure on {1, 2, ..., n} , sat- 
isfying i) and ii). 

(One can give more explicit definition of -f^ : we start by putting i^ (1, 1) = 
min {xi (1) , X2 (1)} • If it turns out that Xi (1) = -^(l?!); then we put 
K{1J) = Oforj > 1. Otherwise we defined (1,2) = min{xi (1) - i^ (1, 1) , X2 (2)} 
If it turns out that xi (1) = K{l,l) + K (1, 2) , then we put K (1, j) = for 
j > 2, otherwise defining K (1,3) = min {xi {!)- K{l,l)- K (1, 2) , X2 (3)} , 
etc.) 

Because of ii), the difference X2 (') — X2 {■) — K {1, ■) is still a (positive) 
measure on {1,2, ...,n}, and, because of iii), X2 (') ^ Xi(')5 considered as 
the measures on {2,3, ...,n}. Therefore we can repeat the preceding con- 
struction, defining the second row, K (2, ■) , as the measure on {2, 3, ..., n} , 



corresponding to X2 (') and x 



. Proceeding inductively, and consid- 

{2,3,. ..,n} 



36 



ering the measures X2 (') ^^ {^5 k + 1, ..., n} , we obtain the couphng K {i,j) 
sought. By construction, K {i,j) = for j < i. Finally, we define the measure 

X3 by 

X3{j) = K{l,j) + ... + K{j,j). 

By construction, Xs ^ Xi) while Xs < X2- 

To perform the limiting procedure, we now define for every n the atomic 
measures Xi,n with atoms at points {A + k^^, A; = 0, l,...,n — l},by 



Xi,n [ A + k ) = Xi 



\ ,B-A^ ,, , B- A 

A + k , A + {k + l) 

n n 



We then construct the couplings Kn between Xi,n and x?,,n (with Xi,n -< 
X3,n? X3,n < X2,n) in the manner described above. As n ^ 00, the supports 
Sn = supp {Kn) C [A, B] X [A, B] of the measures Kn converge to the limiting 
curve S in the square [A, B] x [A, B] . This curve is the graph of the above 
function / : 

S = {{x,y) ■.y = f{x)}. 

Now we can return to the proof of the statement of the Lemma. Let 
uo G [A, B] be a configuration of the Poisson random field Pi, corresponding 
to the rate measure xi- Let / be the function defined above, xs = /* (Xi) ) 
and the measure C = X2 — Xs (that C is indeed a positive measure follows 
from our construction). Let V be the Poisson random field with the rate 
C, independent of Pi, and Co be its configuration. Then the random set 
ui = f (uj) U uj has distribution of the configuration of the Poisson random 
field V2, corresponding to the rate measure X2- To specify the input flow and 
thus the coupling sought, we have to specify the service times. So we assign 
to every point a; in a; the service time r]x, drawn independently from the 
distribution of the random variable rj. To every point y E f {uo) we assign the 
service time rif-i(^y), while to points z E uj we assign independent realizations 

Vz of T]. 

Our statement now becomes almost evident. Consider a Pi-customer, 
represented by a point x E u, whose service is not yet over at the moment 
B. This happens due to the service time rja;, needed for him, as well as due 
to the service of the customers Xi,X2, ■■■, who came before x. But then the 
corresponding 'P2-customer / (x) has the same service time r/^, but arrives 
later than x, as well as all the customers / (xi) , / (0:2) , ..., who came before. 
In addition, there can be extra P-customers arrived before / (x) . It is evident 
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therefore, that the service of the P2-customer / (x) will not be over at the 
moment B. So the queue in the second case is not shorter. ■ 

In what follows we denote by k^"-* the measure on [A, 5], having the 
constant density A (t) = a. 

Lemma 12 Let the measure x on [A, B] has continuous density A (t) , < 
A (t) < L, and satisfies the property: 

xi[A,B])>il-e){B~A). 

Then there exists a segment [A, C] C [A, B] of the length 



C-A>-{B-A) 

1j 



(58) 



such that 



X 



[A,C] 



y n 



(1-2^) 



[A,C] 



Proof. Consider all the segments [c, d] C [A, B] , which have the property 



that 



X 



>- K 



(l-2£) 



[c 



(59) 



Note that if [ci, d]\ and [c2, ^2] are two such segments, and [ci, di\ fl [c2, ^2] 7^ 



0, then the same holds for their union, i.e. 



X 



[czAs,] 



y K 



(l-2£) 



[C3,d3] 



for [03,^3] = [ci,(ii] U [02,^2]- Therefore the union of all segments with 
the property ()59p splits into the family of non-intersecting maximal ones, 
[Ci,Di] , [6*2,-02] , ..., where we enumerate the segments according to their 
length, say, so \Di — Ci\ > 1-02 — 6*21 > ... . Denote by [A, a] the segment 
[Ci, -Dj] among these maximal, which contains the point A. If in fact A does 
not belong to any maximal segment, we put a = A. 

Let now [Ck, Dk] be one of maximal segments, which is different from the 
segment [A, a] . Then 



xi[Ck,D,]) = il-2s)iDk-Ck). 



(60) 



Indeed, let us couple the measure k^^ "^^^ 



X 



[Cfc.-Dfc 



- that is with some measure x 



[Ck,Dk 



with (part of) the measure 



[Cfe.Dfc]" 



<X 



[Ck,Dk 



see the proof of 
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[Ck,Di 



.^ X 



[Ck,Dk 



[Ck,Dk 

--X 



the Lemma ^2 above. This is possible since k'^^ ^^^ 

X ([Cfe, Dk]) > (1 - 2e) [Dk - Cfc) , then the difference Ax 

— X. 

\Ck,Dk\ 

can be coupled with (part of) the measure 



. If 

[Cfc,Dfc] 



is a positive measure on [C^, D^] ■ Therefore for some small 5 

[Cfc,Z)fe] 

the measure k^^"^^-* 

[Ck-S,Ck\ 



Ax 



[Ck-5,Dk\ 



>- fi:(i-2-) 



[Ck-S,Dk\ 



which contra- 



. That implies that x 

diets to the maximality of [C^, -Dfc]. 

Note that for any point x G [A, fi] , which is outside all of the segments 
[Cj, Di] , we have A (x) < 1 — 2£:. Together with (jUU]) it implies that 

x{[a,B])<{l-2e)\B-a\. 

On the other hand, 

X ([A 5]) = X ([A, a]) + X ([a, 5]) > (1 - £) |5 - A| , 

so 

{a- A)L>x ([A a]) > ^ 1^ - ^1 , 

and the proof follows. ■ 

Proof of the Proposition |H1 Let N be fixed. As we know (see relation 
(fTHj) and the statement after it), there is a value c = c (N) < 1, such that the 
homogeneous process with the rate function X = c has the invariant measure 
z/c with A^ (z/J = 2N. We define e (N) by 



ciN) 



e{N) 



If we start the process with A = c in the state 0, then it weakly converges with 
time to Uc- In particular, N {fio^dt)) —>■ ^.N, as t ^ oo. Define T = T (N) 
to be the time duration, after which the (monotone) function N{fio,c{t)) 
satisfies A^ (/io,c (t)) > N for all t > T. We want this value T to appear as 
the lower bound of the length of the segment [^.C], obtained in the Lemma 
IT^ That will be the case if the whole segment [A, B] will be of length 



TiN,L) 



LT{N) 
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see (JHEl) • Now, if (|3H|) is satisfied with the T {N,L) and e (N) just chosen, 
then by Lemma ^J the measure A (t) dt is bigger (in the >- sense) than the 
measure c{N) dt on a segment [0,t| with i > T. By Lemma ITT] we have the 
relation ()57|) at i. ■ 

Next we show that for every initial state u of NMP there exists a time 
moment after which the probability of observing the system fJ'u,x^{-) (t) to be 
in the idle state is uniformly positive. 

Lemma 13 Let f^u,x,{-) (■) be NMP, with N {fiu,x,{-) (t)) = N {u) = q. Then 
there exists a time moment T = T (u) and e = e (u) > 0, such that for all 
t>T 

{uo = 0)„ ,.. > e. (61) 

Proof. We first construct an auxiliary stationary ergodic Markov pro- 
cess, which in a certain sense dominates our NMP from above. Namely, let 
T = T' (g) be the time duration proven to exist in Lemma and e be the 
corresponding quantity e' {q). Our Markov process M^^^ (t) will consist of the 
states of some auxiliary server & at moments t, with M^^^ (0) = u. The cus- 
tomers are arriving to G only at moments kT, k = 1,2, ... . Their numbers 
Dlfc are i.i.d., distributed as the number of Poisson fiow of customers with 
constant rate (1 — e), arriving during the time intervals [{k — 1) T, kT] . The 
service times are described by our random variable r]. Since E (77) = 1, while 
e > 0, Mj,e is indeed ergodic. In particular, 

L {e, 6) ^ ^hm {u; = 0)^,^^(,^_,) > (62) 

for any S small enough. 
Now we note that 

(^ = 0)..,.„(.T-.) > Pr (^. (T)) (.. = I £:, m)^^^^^^(,^_,^ , (63) 

where the event 

in the Poisson random fiow, defined by the rate 



£ (T) — 

1 A^ (■) , no customer arrives during the time [{k — l)T,kT]. 

Since the rate Xp {■) is bounded from above uniformly in u, 

PT{Sk{T))>a{T)>0 (64) 
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for some positive function a. On the other hand 



^^(T)) >(^ = 0)^,^^(,^_,). (65) 

Indeed, since /* Xi, (t) dt < T {1 — e) for all s, the two processes f^u,\^{-) 
and M;^ e can be coupled in such a way that to each customer C {t, ff) of the 
process fiu,x^{-), who arrives at the moment t, {I — 1)T < t < IT and uses the 
server for time fj, it corresponds a customer C (t(t) ,fj) of the process M^^^, 
who arrives at a later moment 



t(t) 



t 
f 



1]T = IT 



and needs the server for the same time duration f/. Hence the queue at every 
moment t < kT of the process M^^^ is not shorter than the one for the process 

u -(fc~i)T, „ where 

Xi^-i)Tu^l >^At) ift<(A;-l)T, 
'^ ^ 1^ otherwice. 

From (jM|) , ()65p we infer that for all k > kQ 

where ko is the smallest index k, for which {u = ^) m^jut-S) — \^ (^' ^) ■ (^^ 
course, the value k^ = ko (u) does depend on the initial state u.) 

Thus far we got the desired result ()6H) only for values t G [kT — 6, kT] , 
k > kQ (z/) . To take care of the other values of t-s we should just make 
a change of variables and to start our process from all the different states 
fJ'u,x^{-) (t) , t E [0,T] . Be the convergence in (jH^ uniform in u, that would 
be the end of the proof. However this is not the case. Yet, this does not 
create any problem, since the family of states {fiu,x^{-) (t) ,t ^ [O?^]} 5 which 
will be taken for initial states of the process M,, e, is compact, and on it the 
convergence in (J62|l is uniform indeed. ■ 

We finish this subsection with a statement about the regularity of the 
exit flow. 
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Lemma 14 Let the function p (t) satisfies the strong Lipschitz condition (0) •' 
for some C 

\p {t + At)-p (t) I < Cp (t) At. (66) 

Let V he some initial state of GFP, and A (■) he arhitrary rate function of 
arriving customers. (In particular one can take A = Aj^, thus getting NMP.) 
Then the rate function b (t) of the corresponding exit flow is Lipschitz, with 
Lipschitz constant independent of u, A. 

Proof. Let t be fixed. The informal idea of the proof is the following: 
consider the elementary event zu, which contributes to the output rate b (t) , 
and let c be the customer, who leaves the server at the moment t, being under 
the service for the time duration t. Then the elementary event cc', obtained 
from w by enlarging the service time of c from t to i + At, contributes to 
b{t + At) . So we can get the desired result by comparing the probabilities 
of txJ and tu'. 

This correspondence, however, does not "cover" all the events, contribut- 
ing to b{t + At) . Namely, the elementary events not covered by the above 
correspondence, are precisely those events w", for which the customer c, 
which is the last customer who has started his/her service before the mo- 
ment t, is different from the customer c", whose service terminates at t + At. 
This, though, means that the service time of c" was less than At. 

To implement this idea, let us write the measure of our process 



]^A(xi) rfxi]^p(/i) dli 



exp{-/A(T)}5:l 

n=0 \_i=l i=l 

on a segment [0, T] , with any T > t + At (compare with (|M|) ). as 

dU {w) = — 71 (zu) dw, 
with Zt = exp {h (T)} and tt {w) = nr=i [^ i^i) P ih)] , so 

6 (t) = / dU (ro) . 

JBit) 

Here B (t) is the manifold of all elementary events gj, which have a moment 
of service termination to happen at t. (We are treating here the case when 
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the initial state v is concentrated on the configuration cj = 0; the general 
case is totally similar.) 
Let us split the rate 



6 (t + At) = / dn {w) 

JBit+At) 

into two parts. The first one, b' {t + At) , is given by 

b' (t + At) = f dU (w) , 

JB'it+At) 

where B' (t + At) C -B (t + At) is the image of the manifold B (t) under the 
map tz7 -w w', defined in the first paragraph of the present proof. Therefore 



|6'(t + At)-6(t)| 



B{t) 



p{i) 



where t = t(tz7) is the service time of the customer c in w, whose service 
terminates at the moment t. From (1661) it follows that 



\b'{t + At)-b{t)\ <CAt. 
The remaining part b" (t + At) of the rate 6 (t + At) , 

b" (t + At) = f dU (w) , 

JB"{t+At) 

corresponds to the event when some customer c finishes his service during 
the time period [t, t + At] , while the next customer needs time at most At 
to be served. Such an event has probability below b (t) (At) , so the proof 
follows. ■ 

7.2 Estimates on the averaging kernels 

Here we will estimate the densities g^.z (t) , entering into the relation b (x) = 

[A * qx,x] (x) . 

Lemma 15 The family qx^y (t) is weakly continuous in y, for every X. Also 
qx,y (t) > p (t) Pr {server is idle at the moment y — t} . (67) 
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Lemma 16 



oo 

,, (t) < Y.P*- it) Pr {iV^^ > n - 1} = Q,,y it) , (68) 



n=l 



where N^ '^ is the random number of X-Poisson points in the segment [y — t,y]. 
In particular, there exists a constant C = C (p) , such that for t and all 

qx,y (t) < C. (69) 

Proof. Both the relations (jUTj) and ()68|) follow easily from the definition 
(PH|) . To see (lUTj) we note that, evidently, c {u, t) >p (t) . To get (jUH|) , we split 
the event C {u, t) , entering (P7j). into the sum of events C„ (m, t) , n > 1, where 
Cn {u, t) consists of all these outcomes when between the moment u of arrival 
of the first customer and the arrival of the customer who terminates during 
[u + t,u + t + h] precisely n — 2 other customers came. (The event Ci {u, t) 
consists from the outcomes when the first customer himself terminates during 
[u + t,u + t + h] .) But if Cn {u, t) holds, then two independent events have 
to happen: 

r]i + ... +r]n^ [t,t + /i] , 

and 

iVi^'" > n - 1, 

which imply ()68p . 

To see (IHTIjl , we use a rough form of (fHH|) : 



9A,,(t)<$^P*"(t). (70) 

n=l 

Let A = sup( p (t) . Then it is immediate from (J7(J|) that for all t < C 

(00 ^ 

l + ^Pr{r7i + ...+r/„<C} 
n=l 

where rji are i.i.d. random variables, distributed as rj. But the probabilities 
Pt {rji + ... + rjn < C} decay exponentially in n, so the series converges for 
every t. It is a classical result of the renewal theory, that the sum (fTUj) goes 
to a finite limit as t ^ 00, see e.g. the relation (1.17) of Chapter XI in jF]. 
That proves (jUUI) . 
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Continuity of qx^y in y follows from the definition in a straightforward 
way. ■ 

We will need the compactness estimate on the distributions q\^y {t) . We 
will obtain them using the estimate (jUHj) . As the following statement shows, 
the estimate (jUHjl is rather rough; we believe that all the moments of the 
distribution q\y (t) of order less than 1 + 5 are finite. 
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Lemma 17 Suppose that A is such that for some T' and e' > and for all 
T>T' ands>Q 

s+T 

\{t)dt<T{l-e') (71) 

Is 

(see dSSj)^. Then for any & < | 

oo 

t\\,y it) dt<C (A, h) < oo, (72) 

where C (A, h) depends on A only via T' and e' . 

Proof of Lemma I17L We are going to use the simple estimate: for 
every random variable C, and every x > 

Q(T) = Pr{C>r}<r-E(|Cr). (73) 

We also will need an estimate on J^ t°g (t) (it, a < x, where q is the 
density of C- We have: 

I eq{t)dt = -[ ed(Q{t)^ (74) 



oo 



= A^Q {A) + a t^-'Q (t) dt. 

J A 

To apply (fTSj) to (jUH|) we will use the Dharmadhikari-Yogdeo estimate 
(see, e.g. JP], p. 79): if ^j are independent centered random variables, then 

E(i6+...+enr)</?n^/^x:E(ie.r^). (75) 

1 

Here R = R{S) is some universal constant. 
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Introducing ^j = ?7j — 1 (see (fT^ ). and using (f7H|l with x = 2 + 5 and 
(17^1) , we have (see (HU))) 

g„ (t) = Pr {r]i + ... + r/„ > t} = Pr {^1 + ... + ^n > t - n} (76) 

<i?M5(t-n) -('+'') ni+^/2. 

To proceed, we use (fSSjl to write 

/•OO /'OO 

/ t\x,y{t)dt< / t'QA,,(t)dt (77) 

JO JQ 

= J] / tV'^ (t) Pr I A/'i^'^ > n - 1 1 rft . 

n=l '-"'0 

Note that due to (j7ip there exists an a > such that E ( A^^ '^ j < 

(1 — a) t once t is large enough, uniformly in y. The first step is to esti- 
mate every summand by 



I tV" (t) Pr In^'^ >n-l\ dt 



(78) 



< 



n(l+f) 



tV" (t) Pr {N^^y >n-l\ dt+ / tV" (t) 



C?t. 



Now, using (f7i|) and (jTH)) , we have for the second term in (f7S|) : 



tV*" {t) dt < 



n 1- 



n 1 + 



a 



RMs(^ny''^\^^^/^ 



+ bRMsn^+^/^ / t^-^ {t - n) 

A(i+f) 



-(2+5) 



dt 



where C = C {a, 6, Ms) . 

The first term in (fTHj) is negligible. To see that, we first observe: 

Lemma 18 Let < z/ < 1, and N^ be a Poisson random variable: 



Pr {iV^ = k} = e- 
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[vn] 



k\ 



Then 



Pr {A^^ >n} < 



1 



(1-'--)" 



1-u 



provided n is large enough. 

Proof. Note first of all, that if x > and n > x, then 






k\ 
k>n 

In our case we thus have 



fc>0 



X 



n + l 



X 



n! 1-^ 

n+l 



5^Pr{iV: = fc}<e- 



\vn] 



k>n 



n\ 1 — Z/ 



By Stirling, for n large 

Y.Pr{K = k}<^e 

1 



k>n 



l-V 



< 



n"'e 

(l—u-\-\nu)n 



1-U 



To estimate the integral /g"*^^'^''' tV" (t) Pr I.Nt''^ > n - l\ dt we note, 
that in the range of t G [O, '^ (l + f )] "we have 



Pr <! iV^^ > n - U < Pr <! A^ 



T>^,y 



> n-l 



n-l 



We apply to the r.h.s. the last lemma, with u 
large enough and uniformly in y 

^n(l+ — ) 

t^p*"" (t) Pi I N^'^ >n-l\ dt 

n(l+f) 



■. Therefore, for all n 





O 2 

Zf a 

< — e 8 

a 



ty (t) dt 



a 



I 1 ct 



Hence, the moment /p°° t^'gA,?/ (t) dt is finite as soon as the series ^^^ 



n 



6-1-5/2 



converges, which happens when & < f- That proves Lemma IT7I 
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8 The self- averaging relation: general case 

Here we derive a formula, expressing the function b{-) = A (/i, A (■)) in terms 
of the functions A (■), p (■) and the initial state fi of our non-stationary (GFP) 
Markov process. This will be the needed self-averaging relation (J2EI)- We 
remind the reader that /i is a probability measure on the set of pairs {{n, t)}U 
0. 

Theorem 19 Let N (/x) = q, and the rate function A (■) satisfies the conclu- 
sions of the Lemma ^ 

rs+T 

/ \{t) dt<T{l- e') for all T>T' >0, all s > and some e' > 0. 

(79) 
Then there exists the family of probability densities qx,ij.,x (") ? ^ > O5 '^'^^ ^^^ 
functional ex,^ (x) and Q\^^ {x) , such that 

b {x) = (1 - ex,^, {x)) [A * gA.^.x] {x) + £^a,m {x) Qx,,, {x) ■ (80) 

Moreover, 

£x,fi (x) —^ as X ^ 00, (81) 

thought not necessarily uniformly in fi, while Q\^^ (x) < C, uniformly in A, ix 
and X. 

Proof. We start by defining the functional e\^^ (x) . Note that the de- 
scription of the realization of our process up to the moment x consists of the 
following data: 

i) the initial configuration (n, r) , drawn from the distribution /i (with n 
to be the number of customers in the system before time zero, r being the 
time the first one already spent in the server); 

ii) the random set < Xi < ... < Xm < x (with random number m of 
points), which is a realization of the Poisson random field defined by the rate 
function A (restricted to the segment [0, x]), independent of (n, r) (the arrival 
moments of the customers, which come after time moment zero); 

Hi) one realization r]i of the conditional random variable t]t- = ir] ~ r r] > r 

and n + m — 1 independent realizations rik,k = 2, ...,n + m oi the random 
variable r] (service times for the customers). 
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We denote by ff_i^x^r} the corresponding (product) distribution. The dif- 
ference 1 — ^A.M (x) is by definition just the P^^A(g)r;-probabihty of the event 

n+m 

Y,Vk<x. (82) 

1 

(If n = 0, then by definition we put r = 0; we put also J2i — 0-) 

The meaning of the decomposition (j8Uj) can be explained now: the first 
term corresponds to the exit flow computed over those realizations where the 
relation ()82|) holds, while the second term represents the rest of the flow. 
Let us prove (|HTj) , that is that 

{n+m ^ 

y rjk > x> — > as X — ^ oo. 

To do this, we introduce two independent random variables: 

n n+m 

S^, = ^Vk, Sx = "^Vk- 
1 

Then for every a G (0, 1) we have 



n+l 



{n+m \ 



= Pi{S^ + Sx>x} 

< Pr {S^ > ax} + Pr {Sx > (1 - a) x} . 



Indeed, if 5*^ + ^a > x, then either S^ > ax, or else ^a > (1 — a) x. Since S'^ 
is a random variable, the probability Pr {S*^ > ax} goes to zero for every a 
positive, as X -^ oo, though not necessarily uniformly in /i. For the second 
term we have 

Pr{SA> {l-a)x} 
= J2( P*"" (^) dt Pr {A^^'^' = m} . 

m=l \A'^-a)x / 

Here A^'^'^ is the random number of points of the A-Poisson field in [0, x] . 
Note that E (A^'^'^) < x(l — e') once x > T' . Therefore we can apply the 

49 



same argument which was used in the proof of Lemma El when showing 
that the integral f^ Qx^y (t) ^ as T — > cxd, see fjH^ . It imphes that 
Pr {^A > (1 — a) x} ^ once a is small enough, uniformly in A, satisfying 
(ffn|l . That estabhshes (jHH) • 

Next we define the distributions q\,fj.,x- They are constructed from the ran- 
dom field of the rods {r/^, k = 1, ...,n + m} , defined above, placed at locations 

1 

0, ..., 0, xi, ..., Xm / , via the procedure of resolution of conflicts, defined in 

the previous section. To do it we first introduce the rate bi (x) to be the exit 
rate of the conditional service process under the conditions that 

n n+m 

'^rik = L, ^r]k < X- L. (83) 

1 n+l 

We claim that for some probability distributions qxx.x we have 

Bl (x) = [A * qx,L,x] (x) . 
The distribution gA,/^,x is then obtained by integration: 



qx,^J.,x — / q\,L,x^fj.(g,X(g,ri I /_^Vk ^ dL 



(The random variable ^" tj^ is of course independent of the Poisson A- 
field.) The output rate hi (x) corresponds to the situation when we have 
customers arriving at the moments 0,xi,...,Xm, which have serving times 
L, ?7„+i, ..., rjn+m, and which satisfy the relation 



n+m 



L+y^^r]k < X. 



71+1 



So we have to repeat the construction of the Section 5 in the present sit- 
uation. Few steps require some comments. The transition from the rela- 
tion (jHTj) to (jHH|) uses the fact that for any s the measure n^=i P i^i) ^k is 
invariant under the coordinate permutations Sg in R^. But the same Sm 
symmetry evidently holds for the conditional distribution of the random vec- 
tor < {rjk, fc = n + 1, ..., n + m) ^"Vi Vk < x — L> , since both the uncon- 
ditional distribution and the distribution of the condition are S'^-invariant. 
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The next crucial step was the relation (j41|) . stating that the functions q\^y 
are probability distributions. It was based on the Theorem 0] The situation 
at hand is somewhat more delicate, since the rods we are dealing now with, 
are of two kinds: the first one has a non-random length L, produced by the 
initial state /i, while others are situated at the Poissonian locations {xj} , 
defined by the rate function A. However, under condition Y^^^Xi Vk < x — L 
the needed combinatorial statement (about the quantity m\) still holds, and 
is the content of the Theorem IHl These remarks allow one to carry over the 
construction of the Section and so to establish the existence of the prob- 
ability densities qx,L,x, and thus also qx,^,x- The upper and lower estimates 
on gA,^,a; are obtained in the same way as were the estimates for g^.x in the 
preceding section. 

The function Qa,^ (x) is the rate of exit flow of our process, conditioned 
by the event 

n+m 

1 

The boundedness of the Qa,^ {x) follows from the following property of the 
service time distribution p (x): for every x,r, x>r>0, l>t>0 



P{^) <^, 



p [X — T 



p{x + t) 



P ix — T + t 



T] > T 

< C. (84) 



r] > T 



The relation ()84|) follows easily from the condition (jH| , with C = C (C) . 
To explain the boundedness, consider the elementary event 

(n, r) X {xi, ..., Xm : < xi < ... < Xm < a;} X {r^i, ..., 7]n+m] , 

which contributes to the output flow inside the segment [x, x -|- Ax] , which 
flow is accounted by the second term of ()8()j) . That means that our rod 
configuration produces after resolution of conflicts a hit inside [x, x + Ax] , 
and also that 

n+m 

^r]k> X. (85) 

1 

In the notation of the Section 6 it means that after resolution of conflicts 
the endpoint yk of some (shifted) rod flts within [x, x + Ax] , for some k G 
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{l,...,n + m}. Let k be the smallest such index. But then the elementary 
events 

{n,T)x{xi,...,Xm -.0 < Xi < ... < Xm < x} X {?7i, ..., ?7^_i, 7^^ + t , Tl^^i , . . . , r]n+m} 

with any t G {Ax, 1) , do not contribute to the output flow inside the segment 
[x, X + Ax] , while still satisfying (jHS}. Therefore, due to (jHH), the probability 
that the customer would finish his service during the period [x, x + Ax] , is 
of the order of Ax, and, moreover, 

Qa,m (x) < — . 



Let now 971 gAI i-^q (^)) be some invariant measure of the dynamical 
system (fT^ . Then 9Jl-almost every state JIq G Alg (f2) belongs to the family 
{fit '■ — oo < t < +00} , such that for all r > 0, all t 

Trifit) = P't+T- 

Let us fix one such family {fit}- Then the function A (t), —00 < t < +cx3, 
which for every —00 < r < +00 satisfies on [r, +00) the equation 

A(-)=A(/i„A(-),r), 

is well defined. Then, according to the equation (jSUI) , for every r, — cxd < 
r < +00, and for all x > r 

A (x) = (1 - £A,/ir (x)) [A * q\,ii,,x] (x) + £A,Ar (x) Qx,iir i^) ■ (86) 

One would like to pass here to the limit r — i> — oo. According to ()8H) , for 
every x we have ^A./i^ (x) — > as r ^ — cxo. Moreover, it is not difficult to 
show that in the same limit qx^ji^^x (■) -^ <lx,x (■) • So the following equation 
holds for A : 

A (x) = [A * qx^x] (x) , — cxD < X < +00. (87) 

By the methods developed below one can show that every bounded solution 
of ()87|) is a constant. Since, however, we are proving a stronger statement, 
that the dynamical system 7^ has one fixed point on each Aiq (fi) , which is, 
moreover, globally attractive, we will not provide the details. 
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9 Self-averaging =^ relaxation: a warm-up 

Before presenting the general proof that self-averaging implies relaxation, we 
consider the following simpler system: we have infinitely many servers, with 
service time r], distributed according to the probability density p. As the 
customer comes, he chooses any free server, and is served, leaving the system 
afterwards. The inflow is Poissonian, given by the rate function / (x) . If 
we impose the condition that the customers are coming at the rate they are 
living the system, we get the non-linear Markov process. The self-averaging 
relation ()25|) in such a case simplifies to 

b (x) = [f*p] (x) . 

Lemma 20 Let p [x) be some probability density with support, belonging to 
]R+, satisfying the conditions of Section\^ Let f be a positive bounded func- 
tion on R^. Suppose that 



Then f (x) 



c as X 



f * p{x) = f [x) for all X > 0. 
-> oo, for some c > 0. 



(88) 



Proof. Our statement follows easily from the well known results of the 
renewal theory. Let us introduce the function 



(^(x) 







X 



if X < 0, 
if X > 0. 



Then the values of the function / for x > can be recovered from the function 
if and the fact that it satisfies (jHHjl . Indeed, iterating (jHHjl . we find: 



fix) 



[v * P] (x) + 
if{x) 



The function 



(f * p 



{x>0} 



(E 



n=lP ) 



s{x) = J2p*'' 



X 



n=l 



X 



for X > 0, 
for X < 0. 



(89) 



is a key object of the renewal theory; in particular, it is known that it goes 
to a positive limit as x — > oo; see for example the relation (1.17) of Chapter 
XI in [F] . From that and the relation ()89p our claim follows. ■ 
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In fact, the constant c can be computed: if m is the mean value of t], then 

1 f + OO 

hm f (x) = — / [v^ * p] (x) dx. 

This fact, as well as the renewal relation itself - s (x) — »• const as a; — »• oo - 
is a consequence of the statement that the probability density p*" (x) of the 
sum of i.i.d. random variables, r/i + ... + rjn, is well approximated, due to the 
local limit theorem, by the Gaussian distribution 

-{x—nm) jlnv 



-.e 



y2Tmv 
where v is the variance of rj. It becomes very flat as n increases. 

10 Self-averaging =^ relaxation: probabilis- 
tic proof? 

As was already said in Section 2, any function A, defined for a; < 0, and 
vanishing for x < —T, can be uniquely extended to a; > in such a way that 
the relation 

A{0,X{-),-T) = b{-) 

holds with b (x) = A (x) for x > 0. Therefore for every x > we have 

A (x) = [A * gA,x] (x) , (90) 

where q\^x (■) is a probability density supported by the semiaxis {y > 0} , and 

depending on A via its restriction A . Our goal is to show that (jHOI) 

{y<x} 

implies that A (x) relaxes to some constant c as x -^ oo. 

Since the distributions qx^x depend on A (■) in a very complicated way, 
we have to treat a more general statement. Suppose a family of probability 
densities Qx (■) , supported by the semiaxis {y > 0} , is given, where x > 0. 
Let / (x) be a non- negative function, defined on M^, such that 

/ (x) < C for X < 0, 

/ (x) = [f * qx] (x) for X > 0. (91) 
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One would like to show that 

lim / (x) = c, (92) 

a;— »oo 

for some c > 0. That will imply the relaxation needed. 

Motivated by the analysis of the previous section, we will study the equa- 
tion (PT|) by considering the corresponding non-stationary renewal process 
and the resulting inhomogeneous Markov random walk. Unfortunately, the 
relation (|92p does not follow from (j91|) in general, and the reasons are prob- 
abilistic! Before explaining it let us "solve" ()91|) . 

So, let the family {qx,x > 0} be given; we solve (j^ for /, given its 

restriction / 

see dHHl)- We put 

/ (x) for X < 
for X > 0. 



. We do this in close analogy with the previous section, 

{x<0} 



fo{x) 
We define 



fn+l (x) 



f (x) for X < 0, 

[fn * Qx] {x) for X > 0. 



Then for every x the sequence /„ (x) is increasing, and the function / (x) 
lim„^oo fn {x) solves (jHIl). 

We can rewrite the function / in a different way. We define 

^'^^ 10 forx<0, 



gn+i (x) = [gn * Qx] (x) . (93) 

Then for x > we have 

fix) = ^9n{x). 

n>l 

Now we will write the formula for Qn in terms of convolution. Here instead 
of the density p*" of the sum Sn of i.i.d. random variables r/i -|- ... -|- ?7„ of the 
previous Section we have to consider the distribution px of the inhomoge- 
neous Markov walker Sn,x, defined as follows. Remember that at each point 
X G M"^ we have the probability density q^. So when our walker after some 
steps happen to arrive to the location x, then the next move is to the loca- 
tion x + y, with the increment y > distributed with the density q^ (y) . The 
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random variable Sn,x is now defined as the position of tlie above described 
Markov walker after n steps, with the initial position x. With these notation 
we have, by (j^ : 

9n+i (x) = [gi * pi")] (x) . 

Summarizing, we have for x > : 

/ (x) = gi (x) +Y,[9i* Pi"T (^) ' 

n>2 

in analogy with ()89|) . As in the previous section, the Local Limit Theorem 
for the Markov chain Sn,x would imply the relaxation ()92j) . 

We have to note, however, that the relation between the validity of the 
LLT for our Markov chain and the validity of the relation (j92j) is more com- 
plicated. Namely, LLT for Sn,x niight fail, while the relaxation (j92j) might 
still remain valid - or else fail as well! First of all, let us explain that even the 
Central Limit Theorem for Sn,x might not hold, notwithstanding the family 
Qx (■) to have very nice compactness properties. To give one example, consider 
the family of probability densities Ux (t) , a; G M}, where all Ux (■) have for 
their support the segment [0, 1] , and satisfy there < c < Ux (t) < C < oo, 
uniformly in x and t. We define now 

qxit) =Ux{t- {1- {x})) , 

where {•} stays for the fractional part. Then all qx (■)-s have their sup- 
ports within the segment [0, 2] . But the random variables Sn,x do not have 
CLT behavior! Indeed, the random variable Sn^x is localized in the segment 
[[x\ + n,[x\ + n -|- 1] , where [-J denotes the integer part. So the variance of 
Sn,x remains bounded in n ! Nevertheless, for this example it can be shown 
that the relation (j^J^ still holds, and that involves certain statement of the 
type of Perron- Frobenius theorem for our Markov chain. Further modifica- 
tion of this example, when 

Qx (t) =Ux{t-{2- {x})) , 

results in the Markov chain with two classes, and in this case both the CLT 
and the relation (j92p might fail. 

We conjecture here that the LLT theorem for the sums Sn,x holds, if the 
family g^ (■) of transition densities has the following additional property: 
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• For some k,K, < k < K < oo, 

k < ^^ < K, (94) 

provided at least one of the values q^^ (t) is positive. 

The condition (jMj) is reminiscent of the positivity of ergodicity coefficient 
condition, introduced by Dobrushin |Dlj in his study of the limit theorems 
for the non-stationary Markov chains. 

In what follows we will take another road, and we get the relaxation 
property by analytic methods, which seems in our case to be simpler. But 
we still use probability theory, though not the CLT. It would be interesting 
to obtain the desired result by proving the corresponding limit theorem. 



11 Self-averaging =^ relaxation: finite range 
case 

In this section we prove the relaxation for the solution of the equation (jfjlj] 
in the finite range case. 

The reader of the paper of course understands that for our initial problem 
we have to consider the infinite range case. We think nevertheless that the 
finite range case is of independent interest, and moreover, it holds in a much 
more general setting than the infinite-range case. This is why we devote to 
it the present Section. Its content is not used in what follows. 

Theorem 21 Suppose that 

< / (x) < C and is continuous for x < 0, 
/ (x) = [f * Qx] (x) for X > 0, 

while the following three conditions on the family Qx hold: 
i) for some T and all x 

f qx (t) dt = 1, qx (t) = Ofort>T, 
Jo 

ii) the family qx (•) depends on x continuously, 
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Hi) for < t < T 

C>q^{t)>K (t) > 0, (95) 

with continuous positive k, (t) . 
Then the limit exists: 

liin / (x) = c > 0. 

X— >oo 

The property (j95|) holds for the NMP, as follows from the relations (|67|) , 
(|UT|) and (P|l ■ 

Proof, i) We know that the function / is continuous and bounded, 
< / < C So if there exists a value X such that / is monotone for x > X, 
then the function / has to be constant for a; > X + T, and we are done. So 
we are left with the case when the function / has infinitely many points of 
local maxima and local minima, which go to oo. 

ii) Given a local maximum, xq, we will construct now a sequence Xi of 
local maximums, i = 0, —1, —2, ..., —n = —n (/, xq) such that 

• Xo > x_i > X_2 > •••, 

• Xi — Xj_i < 2T, Xi — Xi-2 > T for all i, 

• < x_„ < 2T, 

• / (xj-i) > / (x) for any Xi_i < x, and / (xj-i) > / (xj) , 

• for every x G [xj_i,Xj — T] we have / (x) > / (x^) (of course if the 
segment is non-empty, i.e. Xj — Xj_i > T). 

The construction is the following. Let xq be some point of local maxima. 
Since 

/ (xo) = / / (xo - t) qxo (t) dt, 
Jo 

we have / (xq) < F (xq) = sup {/ (x) : x G [xq — T, xq]} , unless / is a con- 
stant on [xq — T, Xq] , in which case we are done. Let 

y = inf {x G [xq — T, Xq] : f (x) = F (xq) } . If y > Xq — T, or if |/ = Xq — T and 
is a local maximum, we define x_i = y. In the opposite case we have that 
the point Xq — T is not a local maximum of the function / on the segment 
[xo — 2T, Xq — T] . We then consider two cases. 
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In the first one we suppose that the function / on the segment [xq — 2T, Xq — T] 



takes values below F = /('^<')+/(^<'-^) , Let [y,Xo-T] C Jxq - 2T, xq - T] 
be the largest segment for which the inequality / (x) > F holds for every 
X G [y, Xq — T] . We define x_i to be the leftmost point of maximum of / in 
[y, Xo-T]. 

In the opposite case we consider the set S = {x E [xq ~ 2T, xq — T] : f (x) > f {xq — T)} 
It contains other points besides Xq — T. However, it can not contain all the 
segment [xq — 2T, xq — T] . Since / is not a constant on [xq — 2T, xq — T] , 
sup_5 f > f {xq — T) . Let z G (xq — 2T, xq — T) be such that f (z) < f {xq — T) . 
Let 5*1 = S* n [z,xq — T]. We necessarily have that sup^.^ f > f {xq — T) as 
well. We define a;_i to be any point in 5*1 where / (a;_i) = sup^.^ /. Clearly, 
x_i is a local maxima of /, while Xq — x^i < 2T. 

We proceed to define the sequences Xi by induction, i = 0,-1,-2,... . 
It is not excluded that Xi G [xj+i — T, Xi+i] for some i. However that means 
in particular that the point Xi is the first maximum point of the function / 
on the segment [xj+i — T, Xj+i] , and since / (a;j_i) > / (xj) , we have that 
Xi_i ^ [xi^i — T, Xi^i] for all i. We stop when we arrive to a first value below 
2T. 

in) In the same way, starting from a local minima yo, we can construct a 
sequence yi of local minima, such that 

• yo> y~i > y-2 > •••, 

• yi- yi-i < 2T, y^ - yi_2 > T for all i, 

• < !/_„ < 2T, 

• / (yi-i) < f (x) for any yi_i < x, and / (t/i„i) < / (yi) , 

• for every x G [yi-i,yi — T] we have f {x) < f {yi) (if the segment is 

non-empty) . 

We can suppose additionally that Xq > yo > a:_i. 

iv) Note that the (finite) sequence Xi do depend on the initial local minima 
Xq, which was used for the starter. The bigger xq is, the longer the sequence 
Xi is. So let us introduce the sequence Xq of such starters, and we suppose 
that Xq > N. In that way we will obtain the family x\ of sequences of local 
maximums of /, i = 0, —1, ..., —n ( /, Xq ) , with n ( /, Xg ) ^ oo as A^ — > 



59 



oo. (Of course, in well may happen that for different A^-s the corresponding 
sequences share many common terms.) 

Denote by M the limit lim inf tv-^oo / f^^o ) • In the same way we can 

introduce the limit m = lim sup^y^^o^ / ( l/o ) • Clearly, M > m, and if we 
can show that M = m, then we are done. So we suppose that M — m > 0, 
and we will bring that to contradiction. 

v) Let us fix e > 0, e < ^~™ , which is possible if M — m > 0. Then one 

can choose A^ so large, that at least 99% of terms of the sequence / ( xl_l 



/( 



x\ ] are less than y. We will fix that value of A^, and we will omit A^ from 

our notation. Therefore without loss of generality we can assume that for 
some i (in fact, for many) we have f (x) < f (xj) +e^ for all x E [xi — T, Xi] . 
Therefore for the set K = {x E [xi — T, Xi] '■ f (x) > / (xj) — e} we have: 

g,^ (t) dt>l-€. (96) 

K-{x,-T) 

Hence, for its Lebesgue measure we have 

mes {K} > 



C ' 

with C = sup /. 

Consider now the corresponding sequence of minima, {yk} , and the seg- 
ments [yk — T, yk] . We claim that the set K has to belong to the union of 
these segments. That would be evident if the segments in question were 
covering the corresponding region without any holes. However, that is not 
necessarily the case, and there can be holes between the segments, since in 
general the differences yi — |/j_i can be bigger than T. Yet, this does not 
present a problem, since by construction the function / is smaller than m 
outside the union of the segments [yk — T, y^] , which implies that the set 
K indeed is covered by these segments. Since diam (K) < T, there exists 
k = k {K) , such that K C [yt-i - T, yk-i] U [yk - T, yk] U [yk+i - T, yk+i] . 
Without loss of generality we can assume the set K "fits into [yk — T, yk 
in the sense that 

mes {K n [yk - T, yk]} > ^ > 






3C 
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while we have f (x) > f {yk) — e^ for all x G [y^ — T, yk\ ■ So we have 

/ qy, (t) dt>R (^) , (97) 

where we define the function R (a) by 

R (a) = inf / k (t) dt. 

Ac[0,T]:mes{A}>a J j^ 

By construction, the set Kn[yk — T, yk] is disjoint from the set L C [yk — T, yk] , 
which is defined hj L = {x E [yk — T, yk] : f (x) < f (yk) + e} . Since 

/ iVk) = fiVk-t) Qy^ (t) dt, 
Jo 

we have similar to ^^ that 

/ qy,it)dt>l-e. (98) 

JL-{yk~T) 

But since qy^ (t) dt is a probability measure, we should have that 
because of dHj), (jHEI)- This, however, fails once e is small enough. ■ 

12 Self-averaging ==^ relaxation: infinite range 
case 

We return to the equation (jHH), / (x) = [/ * qx] (x) . Now we will not suppose 
that the measures q^ have finite support. Instead we suppose that 

1. The family q^. has the following compactness property: for every e > 
there exists a value K (e) , such that 

/ qx{t) dt>l-e (99) 

Jo 

uniformly in x. 
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2. For every T the (monotone continuous) function 

Ft (6) = inf inf [ q^ it) dt (100) 

x>X{T)Dc[0,T]:Ji^ 



mes 



D>5 



is positive once S > 0, for some choice of the function X (T) < oo. 

3. The family q^ is such that the function /, with solves (jyij) , is Lipschitz, 
with Lipschitz constant C = C {{q}) ■ 

As we know from the Section [7| these conditions are indeed satisfied in 
the specific case of the non-linear Markov process and the equation ()90p . 
Indeed, fl99|) follows from Lemma [7| and Lemma El ()100p - from Lemma El 
and Lemma El while Lipschitz property follows from Lemma El 

Theorem 22 Let f satisfies f (x) = [/ * qx] (x) for x > 0, with the kernels 
q^ having three properties listed above. Then f relaxes to a constant value as 
a; — >• cxD. 

12.1 Approaching stationary point 

Lemma 23 i) Let M = limsup^^g^/ (x) . Then for every T and every e 
given there exists some value Ki, such that 

inf f(x)>M-e. 

x€[Ki,Ki+T] 

a) Let m = lim inf 3.^00 / {x) ■ Then for every T and every e given there exists 
some value K2, such that 

sup f (x) < m + e. 

xe[K2,K2+T] 

Moreover, the conclusions of the lemma remains valid if the function f sat- 
isfies a weaker equation (see i\8U^ ) 

f{x) = {l-e (x)) [f * gj (x) +e{x)Q (x) , (101) 

with e (x) -^ as X —> 00 and Q (■) < C. 
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Proof, i) Let S > 0. Then there exists a value S = S (S) > 0, such that 
for all X > S* we have f (x) < M + 5, and e (x) Q (x) < |. Further, there 
exists a value R = R{6) > S, such that for all y > R 

qy it) dt < 6, 

R-S 

see (jnni)- Finally, there exists a point y = y (S) > R + T, such that / (y) > 
M — |. Due to the equation (jl(Jl|) we have 



f{y) = {l-eiy)) 



ys 



Uo 



f{y-t) qy (t) dt+ f{y-t)qy (t) dt 
■ly-s 



-e{y)Q{y). 



Let A > 0, and A = {x G [y - T, y] : / (x) < M - A} , while a = J^qy (t) dt. 
We want to show that the measure a has to be small for small 6. Splitting 
the first integral into two, according to whether the point y — t is in A or 
not, we have 

M - 6 < a{M - A) + {1 - a - 6) {M + 6) + 6C, 

C + 2-M 
a < 6- 



so 



A 
which goes to zero with S, provided A is fixed. Therefore 

.C + 2- M^ 



mes {A} <F^U5 



A 

(see poop ). Since Fj7^ (m) — > as u — > 0, that proves that for any given A the 
Lebesgue measure mes{y4} -^ as 5 — > 0. Since the function / is Lipschitz, 
we conclude that inf^.g[j^_ry] / (x) > M — A — £mes {A} > M — 2A, provided 
6 is small enough. Taking A = e/2 finishes the proof. 

a) Let (5 > 0. Then there exists a value 5* > 0, such that for all x > S* we 
have / (x) > m — 6. Again, take R> S, such that for all y > R 



R~S 



qy (t) dt> 1- 5. 



Finally, there exists a point y > R + T, such that f (y) < m + S. Due to the 
equation pOlj) we have 



/(2/)>(l-x) 



y—S roc 

fiy-t) qy (t) dt+ f{y-t)qy (t) dt 

Jy-S 



(102) 
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where x can be supposed arbitrarily small. Let A > 0, and 
A = {t e [0,T] : f {y - t) > m + A} , while a = J^Qy (t) dt. We want to show 
that the measure a has to be small for small 5. Splitting the first integral 
into two, according to whether the point y — t is in A or not, and disregarding 
the second one, we have 

m + 5 > (1 - x) [a (m + A) + (1 - (5 - a) (m - (5)] . 

For X so small that x[a{m + A) + {1 — a — 5) {m — 5)] < (5, we have 

m + 2(5 > a (m + A) + (1 - a - (5) (m - (5) , 

so 

^m + 3 
a < — T — , 

A 

which goes to zero with 6, provided A is fixed. Therefore 



mes{A} < FfM (5 



m + 3' 



and the rest of the argument coincides with that of the part i). ■ 

12.2 Absorbing by stationary point 

We now will show that if / satisfies (J9T|l , then the property mix^[K,K+T] f (x) > 
M — e implies that for all x > -ft' + T 

/(x) >M-£-c(r), (103) 

with c (T) — i> as T ^ oo. That clearly implies relaxation. (Note that we do 
not claim that ()103|) holds for the solutions of (jlOlj) ). We will show it under 
the extra assumption that the distribution p (■) has finite moment of some 
order above 4. This assumption will be used only throughout the rest of the 
present subsection. 

Using the linearity of (j^T|) , we will rewrite our problem slightly, in order 
to simplify the notation. 

Let the function / > satisfies / (x) = [/ * qx] {x) for x > 0, and 

i) / (x) > 1 for X G [-T, 0] , 

ii) for some (3 > 1 and B < oo and for every x we have 



/ t^q^ (t) dx < B, (104) 

Jo 
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compare with (j72j) . We want to derive from that data that for some c (T) > 0, 
c (T) — » as T — > oo 

/ (x) > 1 - c (T) for all a; > 0. 

Denote by 

Since f > g, we have / (x) > gi (x) = [(^o * Qx] (x) for x > 0. We define 
gi (x) = (^0 (x) for X < 0. Iterating, we have / (x) > (?„ (x) , where 

. r^^ - / 90 (x) x<0 

^" ^^ I k-i * gj (x) X > ■ 

Hence, / (x) > g^o (x) . The function g^o (x) has the following probabilistic 
interpretation: we have a Markov chain on R^, where transition from the 
point X is governed by transition densities g^. to make the step (to the left), 
(and which steps to the left are defined in an arbitrary way for x < 0); then 
the value goo (x) for x > is the probability that starting from x we will visit 
the interval [— T, 0] . The question now is about the lower bound on g^o (x) 
over all possible q^ from our class. 

So let us take x > 0, and let start the Markov chain X„ from x, (i.e. 
Xo = x), which goes to the left, and which makes a transition from y to y — t 
with the probability qy (t) dt. We need to know the probability of the event 

Pa; {there exists n such that X„ G [— T, 0]} . 

In other words, we want to know the probability of X^.y visiting [— T, 0] . We 
would like to show that 

P,{X{.| visits [-T,0]} >7(/5,5,T) (105) 

with 

7 (/3, 5, T) ^ 1 as T ^ cx) 

uniformly over the families g^ from our class. 

Note, however, that in general such an estimate does not hold. For exam- 
ple, the process X{.} can well stay positive for all times. The more interesting 
example where the process goes to — oo, follows, so we will need further re- 
strictions on the family g^.. 
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Example. Let T be given. We will construct the family gj from our 
class (I1U4|) . such that for the corresponding process Xj, 

P^{Xf I visits [0,T]} =0. 

We define gj (t) for x G {k,k + 1] with integer A; 7^ to be any distribution 
localized in the segment [k — l,k] (the uniform distribution on [k — l,k] is 
OK). For X G (^, 2^]) ^ = 1? 2, ..., it is defined by 

r e~* if t > T + 1 

gj (t) = I 2'=+! (1 - /^°;, e-*t/t) iite[x-^,x-^] 
y otherwice. 

For X < it is defined in an arbitrary way. ■ 

The mechanism of violating the relation ()105|) is that the time the process 
XT^ can spend in the segment [0, 1] is unbounded in T. As the following 
theorem shows, this feature is the only obstruction for the statement desired 
to hold. 

Theorem 24 Consider the Markov chain X^.y defined above via the transi- 
tion densities Qx (t) . Suppose that condition ^1U4\ I holds, and that in addition 
these densities are uniformly bounded in the vicinity of the origin: for all real 
X and all t in the segment [0, 1], say, 

q. (t) < C. (106) 

Then for some 7 (/?, B,C,T) ^ 1 as T ^ 00 we have: 

P, {X{.^visits [-T, 0] } > 7 iP, B, C, T) . 

The condition ()106|) holds in the case of NMP, see estimate ()69|) from 
Lemma ^1 

Proof. We will estimate the probability of the complementary event: 



P^ {X{.}misses [-T,0]} 



E 



fc=0"^0 



Qy (t) dt 

y+T 
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Pk (x, dy) . 



Here Pk {x, dy) is the probability distribution of the chain X{.} after k steps, 
/ +T 'iy (^) ^^ ^^ (^' ^y^ ^^ ^^^ probabihty that the chain 



and the expression 

X{.} arrives after k steps to the location y, and then makes a jump over 
the segment [— T, 0] . (In our case the probability of the event that X. never 
becomes negative equals zero.) So we have 



P^ {X{.} misses [-T,0]} 
Jo 



'0 

[x]+l 



fc=0 

oo 



<Y,B{n + ry^ Yl P^ (^' [^' ^ + 1]) 



n=0 



A:=0 



where Pk (x, [n, n + 1]) is the probability of the event X^ G [n, n + 1] , and 
where in the second line we are using the following simple estimate: 



qy it) dt = r 



''OO /'OO 



r'^qy (t) dt < r"^ / rqy (t) dt. 





Now, 



fc=0 



^P,{XfcGKn+l]} (107) 

oo 

J] J^ P^ {Xfc G [n, n + 1] , X; > n + 1, X^+i G [n, n + 1]} 

A:=0 Kk 

oo 

^P,{X/>n+l,Xz+iG Kn + 1]} 

1=0 

Y, p.' {^«+fe G [n, n + 1] Xi>n + 1, X,+i G [n, n + 1]} . 



fc>0 



Let now the random variables Q be i.i.d., uniformly distributed in the segment 
[O, ^] , where C is the same as in ()105p . Then is easy to see that 

F,{Xi+ke [n,n + l] Xi>n+l,Xi+ie [n,n + l]} <Pr{Ci + ... + a< 1} 
Since the last probability decays exponentially in k, while 



67 



Y^'^0 ^x {^i > n + l,Xi^i G [n, n + 1]} = 1, we conclude that 

oo 

Y,^,{Xke[n,n + l]}<K{C). 
Since the series X^n"^ converges for /3 > 1, the proof follows. ■ 

13 Self-averaging =^ relaxation: noisy case 

In this section we establish the relaxation for the NMP with general initial 
condition. Using the fact that the Poisson rate A (x) = A^ (x) of the NMP 
with initial state /x satisfies the equation 

A (x) = (1 - £a,m (x)) [A * gA,M,J (x) + ^A,/. (x) Qx,f^ (x) , 
we will prove the following 

Theorem 25 Let the initial state fi of the NMP fit is such that both the 
expected service time S (fi) and the mean queue length N (fi) are finite. Then 
the limit c = lim^i-joo A (x) exists; moreover, fit ^ Vc as t ^ oo, where Vc is 
the invariant measure of NMP, such that X^^ {x) = c. Also N (z/^) = A^ (/i) . 

We are not able to prove this theorem in the generality of the previous 
Sections. Below we will use all the specific features of the NMP-s, and in 
particular we will use the comparison between different NMP-s and GFP- 
s, corresponding to various initial states and input rates. The comparison 
mentioned is based on the coupling arguments. 

13.1 Coupling 

Definition 26 Let fii,fi2 be two states on Q. We call the state fii to be 
higher than fi2, f^i ^ f^2, if there exists a coupling P [duji,duj2] between the 
states /ii,/i2 5 with the property: 

P [{Q X Qf] = 1, 

where 

(fi X fi)> = {[(ni, Ti) , (n2, T2)] e CI X n : ni > n2} ■ 
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Clearly, if /ii '^ /i2, then A^ (/ii) > A^ (/i2) . 
Next, we introduce the stronger relation. 

Definition 27 Let /ii,/i2 ^e tvjo states on Q. We call the state fii to be 
taller than fi2, /Ui !^ fJ'2, if there exists a coupling P [dui, duj2\ between the 
states /ii,/i2, with the property: 

P [iSl X fi)»] = 1, 

where 

(fi X Vty^ = {[(ni,ri) , (n2,r2)] G fi x fi : ri = r2,ni > n2 or (n2,r2) = 0}. 

Lemma 28 Let fii (0) , fi2 (0) be two initial states onQ att = 0, and Ai (t) , 
^2 (^) ) ^ ^ be two Poisson densities of the input flows. The service time 
distribution is the same 77 as before. Let fii (t) be two corresponding GFP-s. 
Suppose that jii (0) ^ /i2 (0) , and that Ai (t) > A2 (t) . Then fj,i (t) )p JI2 (t) , 
so in particular 

iV(/ii(t))>iV(/i2(t)). 

Also, there exists a coupling between the processes such that for almost every 
trajectory {ui (t) , 002 (t)) 

Siiu^it))>Sicu2{t)). (108) 

Proof. To see this let us construct the coupling between the processes 
Hi (t) . Let us color the customers, arriving according to the A2 (t) flow, as 
red. We also assign the red color to the customers which were present at 
time t = from the initial state fi2 (0). Let 7 (t) = Ai (t) — A2 (t) , and 
consider 7 (t) as the extra input flow of blue customers (with independent 
service times). We also add blue customers at time t = 0, which are needed 
to complete the state fj,2 (0) up to /xi (0) . Then the total (color blind) flow 
coincides with Ai flow, while the total (color blind) process coincides with 
/ii (t) . 

The service rule for the two-colored process is color blind: all the cus- 
tomers are served in order of their arrival time. We claim now that along 
every coupled trajectory {ui (t) , 002 (t)) we have r (cui (t)) > r {u2 (t)) , where 
r (■) is the number of red customers at the moment t, waiting to be served. 
That evidently will prove our statement. 
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Clearly, the number r {uj (t)) is the difference, 

r{u{t)) = A{u{t))-B{u{t)), 

where A {u (t)) is the total number of red customers, having arrived before 
t, while B {uj (t)) is the total number of red customers, who left the sys- 
tem before t. Clearly, A{iVi (t)) = A {002 (t)) . Let us show that B {ui (t)) < 
Bico^it)). 

This is easy to see once one visualizes the procedure of resolving the rod 
conflicts, which corresponds to our service rule, for the two-colored rod case. 
Namely, one has first to put all the red rods, and resolve all their conflicts by 
shifting some of them to the right accordingly. The number of thus obtained 
rods to the left of the point t is the number B {002 (t)) . Clearly, if one adds 
some blue rods to the red ones, then each red rod would be shifted to the 
right by at least the same amount as without the blue rods. As a result, 
every red rod would either stay where it was, or move to the right, so indeed 
B{uj,{t))<Biuj2it)). 

The relation ()108|) is evident. ■ 

13.2 Convergence 

Consider a General Flow Process fi (t) with initial state /x (0) = z/ at T = 
and the input rate A (t) = c < 1 (i.e. the usual queueing system M|G/|1). 
This is an ergodic process, so the weak limit 

lim fip^c {t) = I'c 

4— »oo 

exists and does not depend on the initial state v. We would like to show that 
if TV ip) < cxD, then also 

limAr(/ip,,(t)) = Ar(z/,) (109) 

(see p8|)). This however is not true in general, and extra assumptions are 
needed in order to have such convergence. 

Lemma 29 Suppose additionally that S (u) < 00. Then 

\imN{fi^^,{t)) = N{u,). 

Moreover, for every s < 00 the convergence N {fiu,c {t)) —>■ N [uc] is uniform 
on the set of all initial states v satisfying S (z/) < s. 
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Proof of Lemma I29L Since liiiii^oo /^p,c (t) = i^c, linii^oo N {fip^c (t)) ^ 
N (z/c) . To prove the equality we need to show the uniform integrabihty for 
the family of random variables A*"^^ ^(t), which means the following property: 
for every x > there exists a value s^ such that for all t 

where I stands for the indicator. 

Note first that it is enough to show the uniform integrabihty of the family 
S^- ^(t) of random variables. Indeed, consider the event A^ (uj) > N. Then the 
conditional fip^c (t)-probability of the event S (uj) > ^N under the condition 
N (uj) > N goes to 1 as A^ — *> oo, since E (77) = 1. Therefore if the family 
S'^-^^(t) is not uniformly integrable, so is iV^^.^t). 

To get uniform integrabihty we prove the following stochastic domination: 

Lemma 30 

S,,^^it)<S, + S,^. (110) 

(Here in the rhs we mean the sum of two independent random variables.) 

Since the expectation S (z/) of the first random variable is finite by as- 
sumption, while the expectation of the second equals A^ (uc) and so is also 
finite, the uniform integrabihty of the family 5*^- ^(() follows. 

Proof of Lemma I3()L To prove (jllOj) we will use the following con- 
struction. Let xi, r/i; X2,'^2; ... be a realization of the flow of customers. It 
means that at the moment xi the first customer comes, which needs the time 
rji to be served, at the moment X2 the second comes, etc. To every such 
realization we can assign the function W (x) , which is the remaining time 
duration needed for the server to serve all the customers who came before 
the moment x. That is, 

{0 for z < Xi, 

max {rji — {x — Xi) , 0} for Xi < x < X2, 

max {W {x2 — 0) + ri2 — {x — X2) , 0} for X2 < x < X3, etc. 

If fit is a process of states of our server with /iq = So, and {xi,rii] X2, ^72; •••} 
is its realization, then the random variable W (t) is the same as S^^ . With 
obvious modification the W function is defined for a process with non-empty 
initial state fiQ. 



71 



Consider now two processes: /ij,^_c (t) and fiSo,c (t) ■ The first one is station- 
ary. Since evidently u^ > Sq, we have /ij,^,c (t) > At<5o,c (t) , i.e. z/^ :^ fiSo,c (t) 
for all t. It means also that we can couple the two processes in such a way 
that W^"'''" (t) > W'^'^o.'^ (t) with probability one. 

Let us see now how the two processes - iy^*o.c (t) and W^^'" (t) - are re- 
lated. We consider the natural coupling between fj,So,c and fip^c, where the lat- 
ter process is obtained by adding to a general configuration {xi,rii; X2, ^72; •••} 
of the former one extra customer {xq, Ho} , with xq = and the independent 
random variable Ho distributed according to Sp. The trajectory W^^'" (t) is 
obtained in the following way: one considers first the function 






.X 



where 



1 if X > a, 
otherwic 

Let Xq be the first moment when W (x) vanishes. Then 



^0 otherwice. 



|y/...c (^^^f^ (x) if X < Xo 

\ iy^'5o,c (^3,^ otherwici 



otherwice. 

From this the relation ()110j) follows immediately. 

The uniformity of convergence follows from the fact that the function 
S* is a compact function on Q, once the function i?^ (r) is unbounded (see 
(ITT|)). (This compactness means that for every s the set {0; G ^2 : S" (u) < s} 
is compact.) As a result, the family of initial states u satisfying S (u) < s 
is weakly compact as well, which together with continuity of the function 
N {fJ'u,c (t)) in z/ and t provides the claim needed. If the function i?^ (r) is 
uniformly bounded in r, then for some ^ and C the exponential moment 
E (exp {^?7r}) ^ C for all r. Therefore the family of all possible probability 
distributions Fa of the form 



Fe{x)= j F^^{x) de{T) 



where 6 runs over all probability measures on the semiaxis {r > 0} , is com- 
pact. That again implies the uniformity. ■ 
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13.3 End of the proof in noisy case 

Let fiu,x,y{) {t) be the non-linear Markov process with the initial state z/, having 
finite mean queue, A^ (z/) < oo, and finite expected service time S (z/) . We 
will show that the function A (t) = Aj, (t) goes to a limit as t ^ oo. The idea 
is the following: 

Suppose m = lim inf t^oo A (t) < hm sup^^o^^ A (t) = M. As we already 
know from Lemma 1221 for every T, K and every e > there exist values 
Ki,K2 > K such that 

sup \{x)<m + e, (111) 

x€[Ki,Ki+T] 



while 



inf X(x)>M-e. (112) 

x€[K2,K2+T] 



We want to bring this to contradiction, arguing as follows: 

• First of all, we note that the mean queue, A^ (yUi/,A„() (^)) does not 
change in time, staying equal to the initial value A^ (z/) . 

On the other hand: 

• We can compare the state ft,^ a„(-) (-^i + T) with the state /ir /^ -.i , (T) 
Due to (|111|) , the latter is higher, so 

N {^^l,^,,^,,,K.,l^,AT)) > N (u) . (113) 

By the same reasoning, 

^(/^K..(.,M.M-e(^))<^^(-)- (114) 

• We then claim that once T is large enough, the state ur, fi^ \] ^j_^iT) 
is close to the equilibrium Um+e: so in particular 

with e' = e' (T) ^ as T ^ oo. By the same reasoning, 

^ (^K..,.)(^.)]>M-. (T)) > N {uM-s) - e". (116) 
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• Since A^ (i^m-s) > N (t'm+e) once e is small, the choice of e' and e" such 
that e' + e" < N (i'm-s) " ^ i^m+e) makes it possible to deduce from 
the relations (ITT!^ - (fTTKll that 

N{u)>N (uM-e) -e">N (z/„+,) + e' > N [u) , 

which is inconsistent with the properties of the relation > between the 
real numbers. 

We need to prove the relations (jll5|) and (J116p . It turns out that the rela- 
tion ()116p is easier. Indeed, to show it, we can compare the state /ir ^^ xi j^.j_^ (T) 

with the state /io.M-e (T) ■ The latter is evidently lower : 



^(n 



Since /io,M-e (T) is also lower than uu-e, 

N{fio,M-eiT))<N{uM-e)- (117) 

Since yUo,Af-e (T) -^ i^M-e as T ^ oo, pi7|l implies that N {fio^M-e (T)) — *• 
A^ (I'M-e) 5 which proves pifjj) . 

In the above proof the important step was to replace the state fJ'u,x„{-) (-^2) 
with a lower state 0, which is in fact the lowest. Turning to ()115|) , we see 
that this step can not be mimicked there, since there is no highest state! So, 
to proceed, we need some apriori upper bound on the state fJ'u,x^{-) (-^1) • 

Lemma 31 Let v he an arbitrary initial state, with N (u) < 00. Then there 
exist c (z/) < 1 and T < 00, such that for every t > T 

A^(t) < c(z/). 

Proof. The statement of the lemma is equivalent to the fact that M = 
Mmsup^^^X^ (t) < 1. So suppose the opposite, that M > 1. As we then 
know from Lemma 1221 for every T and every e > we can find a segment 
[K, K + T], such that A^ (t) > 1 - e for all t e [K,K + 7]. This, however, 
contradicts to the statement (j33j) of Lemma [7| ■ 

Since S (z/) < 00, and the rate Xi, (t) is uniformly bounded, the function 
S {fiu,x^ {t)) is finite for every t. It can grow, but after the moment T, obtained 
in the last Lemma, it stays bounded from above by the value 5* {fiu,x^ i'^)) + 
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S (uc), because of Lemma IHUl So without loss of generality we can assume 
that the initial state u itself is such that A^ (u) < oo, S (z/) < oo, while 
Xu (t) < c < 1 for all t > and so S {fiu,\^ (t)) < •S' (z/) + S (z/g) . Therefore 
the family of states {fJ'u,\^ (t) ,t> 0} is weakly compact. Hence for every e' 
there exists T such that for all t 

This proves piSj) . 

14 Conclusions 

In this paper we have proven the Poisson Hypothesis for the information 
networks, for the case of the "mean- field" model of the network. We have 
found the domain of its validity, and we will show in the forthcoming paper 
|RSj that beyond this domain Poisson Hypothesis is violated even in the 
mean-field case, and the dependence of the initial condition does not vanish 
with time. We strongly believe that the methods we have developed here - in 
particular, the self-averaging relation - are relevant not only for mean-field 
models, but also for more realistic ones. 

The following problems appear as the natural continuation of our work. 

• The study of Poisson Hypothesis for the case of the service times form- 
ing an ergodic random process, rather than the sequence of i.i.d. ran- 
dom variables. 

• The study of PH for the case of customers of several identities, with 
service times depending on their identity. 

• The study of PH for more general graphs. 

We are going to work on these problems in the near future. 

Acknowledgment. We would like to thank our colleagues - in partic- 
ular, Yu. Golubev, T. Liggett, 0. Ogievetsky, G. Olshansky, S. Pirogov, A. 
Vladimirov - for valuable discussions and remarks, concerning this paper. 
We are grateful to our referee for his remarks, which resulted in a substan- 
tial improvement of the presentation of the paper. We are grateful also to 

75 



the Institute for Pure and Applied Mathematics (IPAM) at UCLA, for the 
uplifting atmosphere and support during the Spring 2002 program on Large 
Scale Communication Networks, where part of this work was done. 



References 

[B] Borovkov, A. A. Talk at INRIA, 1995, see also jBuJ. 

[Bu] Borovkov, K. A. Propagation of chaos in queueing networks. Teor. 
Veroyatnost. i Primenen. 42 (1997), no. 3, 449-460; translation in The- 
ory Probab. Appl. 42 (1997), no. 3, 385-394 (1998). 

[DF] Delcoigne, F.; FayoUe, G. Thermodynamical limit and propagation of 
chaos in polling systems. Markov Process. Related Fields 5 (1999), no. 
1, 89-124. 

[Dl] Dobrushin, R.L. Central limit theorem for inhomogeneous Markov 
chains. Probability Theory and its Applications, I, II, v. 1, p. 72-89, v. 
1, p. 365-425, 1956. 

[D2] Dobrushin, R.L. Private communications, see also |DSj . 

[DKV] Dobrushin, R.L., Karpelevich, F.I., and Vvedenskaya, 
N.D." Queueing Systems with Choice of Shortest Queue - Asymp- 
totic Approach", Problemy Peredachi Informatsii" , 1996, V.32, N.l, 
pp.20-36 

[DS] R.L. Dobrushin and Suhov, Yu. M. Asymptotic investigation of star- 
shape message switching networks with a large number of radial rays. 
Problems of information transmission, 12 (1976), 49-65. 

[F] Feller W. An introduction to Probability Theory and Its Applications, 
2-nd edition, v. 2. John Wiley & Sons, NY, 1971. 

[KRl] Karpelevich, F. I.; Rybko, A. N. Asymptotic behavior of a symmetric 
closed queueing network at a thermodynamic limit. (Russian) Prob- 
lemy Peredachi Informatsii 36 (2000), no. 2, 69-95; translation in Probl. 
Inf. Transm. 36 (2000), no. 2, 154-179 



76 



[KR2] Karpelevich, F. I.; Rybko, A. N. Thermodynamic limit for the mean 
field model of simple symmetrical closed queueing network. Markov 
Process. Related Fields 6 (2000), no. 1, 89-105. 

[K] Kleinrock, L., Communication Nets; Stochastic Message Flow and De- 
lay, McGraw-Hill Book Company, New York, 1964. 

[L] Liggett, Thomas M. Interacting particle systems. Grundlehren der 
Mathematischen Wissenschaften [Fundamental Principles of Mathe- 
matical Sciences], 276. Springer- Verlag, New York, 1985. 

[Ml] McKean, H. P., Jr. A class of Markov processes associated with non- 
linear parabolic equations. Proc. Nat. Acad. Sci. U.S.A., 56, 1966, 
1907-1911. 

[M2] McKean, H. P., Jr. An exponential formula for solving Boltzmann's 
equation for a Maxwellian gas. J. Combinatorial Theory, 2, 1967, 358- 
382. 

[P] Petrov, V. V. Sums of independent random variables. Translated from 
the Russian by A. A. Brown. Ergebnisse der Mathematik und ihrer 
Grenzgebiete, Band 82. Springer- Verlag, New York-Heidelberg, 1975. 

[RS] Rybko, A. N.; Shlosman, S.B.: Poisson Hypothesis for Information 
Networks II. Violation and Phase Transitions, in preparation. 

[St] Stolyar, A. L. The asymptotics of stationary distribution for a closed 
queueing system. (Russian) Problemy Peredachi Informatsii 25 (1989), 
no. 4, 80-92; translation in Problems Inform. Transmission 25 (1989), 
no. 4, 321-331 (1990) 

[S] Stoyan, D. Qualitative Eigenschaften und Abschatzungen stochastis- 
cher Modelle, Akademie- Verlag, Berlin, 1977. 



77 



